Talent.com
Multilingual LLM Data Evaluator (Bahasa Melayu and English)
Multilingual LLM Data Evaluator (Bahasa Melayu and English)Chemin • Ipoh, Perak, Malaysia
Multilingual LLM Data Evaluator (Bahasa Melayu and English)

Multilingual LLM Data Evaluator (Bahasa Melayu and English)

Chemin • Ipoh, Perak, Malaysia
9 days ago
Job description

Chemin is partnering with a well-established enterprise with an innovation arm focused on emerging technologies, infrastructure, and AI-related initiatives. For this project, we are seeking individuals as LLM Evaluators who can read and write Bahasa Malaysia (BM) and English fluently.

You will evaluate AI-generated outputs by reviewing the response accuracy and reasoning or logic, using the chat history strictly as context. This role requires strong language skills, judgment, attention to detail, and the ability to identify logical, grammatical, and structural issues without altering the original meaning of outputs widely.

The key to your success is to ensure a high standard of excellence in performing validations, as quality is critical to enhancing AI models. Ultimately, alongside the Delivery Team at Chemin, you will shape how Malaysian languages are represented in the next generation of powerful large language models by refining a high volume and quality dataset.

  • Deliver precise validations of response outputs with minimal to no revisions.
  • Evaluate LLM prompts :

Ensure the response is accurate and aligned with the conversational context.

  • Verify that the reasoning supports the response logic.
  • Rewrite responses or reasoning where required, depending on the severity of issues.
  • Adapt text to sound natural in the service languages (Bahasa Malaysia and English), especially in cases where LLM outputs are affected by translation-related grammar errors.
  • Maintain the original meaning of the response output while improving sentence structure, grammar, and clarity for minor errors.
  • Discard data points with entirely illogical response outputs or reasoning, as these are unusable for AI training.
  • Proactively communicate challenges, queries, or concerns with Project Managers to ensure smooth operations.
  • Meet key deadlines while maintaining quality and consistency in work output.
  • Qualifications

  • Malaysian citizen fluent in English and Bahasa Melayu (reading and writing).
  • Able to evaluate logic, language clarity, and reasoning structure.
  • Capable of detecting unnatural language caused by machine translation and adapt it while maintaining meaning.
  • Attention to detail and a high level of accuracy in detecting errors in spelling, grammar, and conversation flow.
  • Efficient time management skills to meet and exceed daily deliverables.
  • Professional attitude : responsive and inquisitive to ask clarifying questions.
  • Possess a laptop or desktop computer with a stable internet connection.
  • High attention to detail and ability to follow strict linguistic and structural guidelines.
  • Comfortable working with LLM-generated content and chat-style datasets.
  • Bonus : prior experience in LLM evaluation or validation and data annotation projects, especially in linguistics.
  • Work Arrangements

  • Available for at least 5-8 hours per day, including on weekends when necessary. Flexible core work hours from 9 : 00 am - 6 : 00 pm.
  • Able to commit to the project from November 19th to November 30th, 2025.
  • 100% remote work opportunity.
  • Work from the comfort of your own home.
  • Be part of a forward-thinking AI enablement company in Malaysia.
  • Gain invaluable work experience on an AI solution that represents Malaysian languages and dialects.
  • Accelerate AI development with Chemin by training next-generation language models!

    #J-18808-Ljbffr

    Create a job alert for this search

    Data • Ipoh, Perak, Malaysia

    Related jobs
    Malay Translator

    Malay Translator

    RWS Group • Ipoh, Perak, Malaysia
    You will be responsible for delivering translations of the highest quality and accuracy, on time and within budget.You will act as lead translator for projects and accounts, performing tasks such a...Show more
    Last updated: 30+ days ago • Promoted
    Freelance Luxury Brand Evaluator in Penang, Malaysia

    Freelance Luxury Brand Evaluator in Penang, Malaysia

    CXG group • Ipoh, Perak, Malaysia
    Turn your passion for luxury into a career opportunity! Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles. Join CXG, the global leader in cust...Show more
    Last updated: 30+ days ago • Promoted
    Freelance Luxury Brand Evaluator in Pahang, Malaysia

    Freelance Luxury Brand Evaluator in Pahang, Malaysia

    CXG group • Ipoh, Perak, Malaysia
    Turn your passion for luxury into a career opportunity! Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles. Join CXG, the global leader in cust...Show more
    Last updated: 9 days ago • Promoted
    Become a Luxury Brand Evaluator Automobile Project in Selangor, Malaysia

    Become a Luxury Brand Evaluator Automobile Project in Selangor, Malaysia

    CXG • Ipoh, Perak, Malaysia
    Become a Luxury Brand Evaluator Automobile Project in Selangor, Malaysia.Are you a luxury automobile enthusiast who appreciates the finer details of high-end vehicles? If the answer is yes, we are ...Show more
    Last updated: 30+ days ago • Promoted
    Business Development Manager (Malay)

    Business Development Manager (Malay)

    David Kennedy Recruitment • Ipoh, Perak, Malaysia
    David Kennedy Recruitment is working with an award-winning multi-licensed, broker who offers online CFD trading on FX, crypto, oil, metals, shares, and indices and seeking to onboard a Business De...Show more
    Last updated: 30+ days ago • Promoted
    Hybrid ML Engineer - Diffusion & Vision (Remote-Friendly)

    Hybrid ML Engineer - Diffusion & Vision (Remote-Friendly)

    Bjak • Ipoh, Perak, Malaysia
    A leading AI company in Malaysia seeks a Machine Learning Engineer to develop cutting-edge generative vision features.You'll customize diffusion models and build large-scale datasets while collabor...Show more
    Last updated: 3 days ago • Promoted
    Machine Learning Engineer

    Machine Learning Engineer

    Second Talent • Ipoh, Perak, Malaysia
    Member of Technical Staff - Environments (ML).As an Environment Engineer (ML), you will build on top of our core platform to create the simulation environments in which frontier coding agents learn...Show more
    Last updated: 18 days ago • Promoted
    Freelance Luxury Brand Evaluator in Johor Bahru, Malaysia

    Freelance Luxury Brand Evaluator in Johor Bahru, Malaysia

    CXG group • Ipoh, Perak, Malaysia
    Turn your passion for luxury into a career opportunity! Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles. Join CXG, the global leader in cust...Show more
    Last updated: 30+ days ago • Promoted
    Become a Luxury Watch Brand Evaluator in Kota Kinablu, Malaysia

    Become a Luxury Watch Brand Evaluator in Kota Kinablu, Malaysia

    CXG • Ipoh, Perak, Malaysia
    Turn your passion for fine timepieces into a rewarding freelance opportunity!.Explore the world of luxury watchmaking and make a lasting impact on some of the world’s most prestigious horology bran...Show more
    Last updated: 30+ days ago • Promoted
    Reliability Engineer (Based in Ipoh)

    Reliability Engineer (Based in Ipoh)

    Coherent Corp. • Ipoh, Perak, Malaysia
    Develop and implement reliability test plans for qualification.Define reliability requirements and acceptance criteria in collaboration with design, quality, and manufacturing teams.Use statistical...Show more
    Last updated: 23 days ago • Promoted
    Freelance Luxury Brand Evaluator Automotive Project in Kinablu, Sabah, Malaysia

    Freelance Luxury Brand Evaluator Automotive Project in Kinablu, Sabah, Malaysia

    CXG • Ipoh, Perak, Malaysia
    Are you a luxury automobile enthusiast who appreciates the finer details of high-end vehicles? If the answer is yes, we are looking for you!. As a Luxury Brand Evaluator, you will step into the worl...Show more
    Last updated: 30+ days ago • Promoted
    Join the Welo Data Network – Malay Speakers in Malaysia

    Join the Welo Data Network – Malay Speakers in Malaysia

    Welocalize, Inc. • Ipoh, Perak, Malaysia
    At Welo Data, we’re at the frontier of AI and localisation, providing high-quality language data that fuels smarter, more inclusive technologies. As part of the Welocalize family, we partner with le...Show more
    Last updated: 30+ days ago • Promoted
    Remote LLM Evaluator : English & Bahasa Malaysia

    Remote LLM Evaluator : English & Bahasa Malaysia

    Chemin • Ipoh, Perak, Malaysia
    A forward-thinking AI enablement company in Malaysia is seeking LLM Evaluators to validate AI-generated outputs.Candidates must be Malaysian citizens fluent in Bahasa Malaysia and English, with exc...Show more
    Last updated: 6 hours ago • Promoted • New!
    Online Data Analyst - English speakers in Malaysia (Remote)

    Online Data Analyst - English speakers in Malaysia (Remote)

    TELUS Digital AI Data Solutions • Ipoh, Perak, Malaysia
    Online Data Analyst - English speakers in Malaysia (Remote).Direct message the job poster from TELUS Digital AI Data Solutions. In this role, you will be working on a project aimed at enhancing the ...Show more
    Last updated: 30+ days ago • Promoted
    Freelance Malay Translator

    Freelance Malay Translator

    RWS Group • Ipoh, Perak, Malaysia
    We are seeking a dedicated freelance English to Malay Translator to collaborate with one of our esteemed clients.This is a remote opportunity offering competitive remuneration for the right candida...Show more
    Last updated: 18 days ago • Promoted
    Audio Data Collection & Transcription Project (Native English speakers in Malaysia) - Remote

    Audio Data Collection & Transcription Project (Native English speakers in Malaysia) - Remote

    TELUS Digital AI Data Solutions • Ipoh, Perak, Malaysia
    Audio Data Collection & Transcription Project (Native English speakers in Malaysia) - Remote.Get AI-powered advice on this job and more exclusive features. Direct message the job poster from TELUS D...Show more
    Last updated: 5 days ago • Promoted
    LMS Data Analyst and EdTech Lead

    LMS Data Analyst and EdTech Lead

    Enko Education • Ipoh, Perak, Malaysia
    Be among the first 25 applicants.Get AI-powered advice on this job and more exclusive features.Flexible - Preferably in Africa. Enko Education is on the lookout for a tech-savvy changemaker to lead ...Show more
    Last updated: 30+ days ago • Promoted
    Strategic Health Systems Sales Leader; Malaysia Country Lead

    Strategic Health Systems Sales Leader; Malaysia Country Lead

    Philips International • Ipoh, Perak, Malaysia
    A global health technology leader is seeking a Health Systems Sales Leader and Country Manager for Malaysia.The candidate will be responsible for developing sales strategies, leading a team, and ma...Show more
    Last updated: 8 days ago • Promoted