Talent.com
Multilingual LLM Data Evaluator (Bahasa Melayu and English)
Multilingual LLM Data Evaluator (Bahasa Melayu and English)Chemin • Putrajaya, Putrajaya, Malaysia
Multilingual LLM Data Evaluator (Bahasa Melayu and English)

Multilingual LLM Data Evaluator (Bahasa Melayu and English)

Chemin • Putrajaya, Putrajaya, Malaysia
9 days ago
Job description

Chemin is partnering with a well-established enterprise with an innovation arm focused on emerging technologies, infrastructure, and AI-related initiatives. For this project, we are seeking individuals as LLM Evaluators who can read and write Bahasa Malaysia (BM) and English fluently.

You will evaluate AI-generated outputs by reviewing the response accuracy and reasoning or logic, using the chat history strictly as context. This role requires strong language skills, judgment, attention to detail, and the ability to identify logical, grammatical, and structural issues without altering the original meaning of outputs widely.

The key to your success is to ensure a high standard of excellence in performing validations, as quality is critical to enhancing AI models. Ultimately, alongside the Delivery Team at Chemin, you will shape how Malaysian languages are represented in the next generation of powerful large language models by refining a high volume and quality dataset.

  • Deliver precise validations of response outputs with minimal to no revisions.
  • Evaluate LLM prompts :

Ensure the response is accurate and aligned with the conversational context.

  • Verify that the reasoning supports the response logic.
  • Rewrite responses or reasoning where required, depending on the severity of issues.
  • Adapt text to sound natural in the service languages (Bahasa Malaysia and English), especially in cases where LLM outputs are affected by translation-related grammar errors.
  • Maintain the original meaning of the response output while improving sentence structure, grammar, and clarity for minor errors.
  • Discard data points with entirely illogical response outputs or reasoning, as these are unusable for AI training.
  • Proactively communicate challenges, queries, or concerns with Project Managers to ensure smooth operations.
  • Meet key deadlines while maintaining quality and consistency in work output.
  • Qualifications

  • Malaysian citizen fluent in English and Bahasa Melayu (reading and writing).
  • Able to evaluate logic, language clarity, and reasoning structure.
  • Capable of detecting unnatural language caused by machine translation and adapt it while maintaining meaning.
  • Attention to detail and a high level of accuracy in detecting errors in spelling, grammar, and conversation flow.
  • Efficient time management skills to meet and exceed daily deliverables.
  • Professional attitude : responsive and inquisitive to ask clarifying questions.
  • Possess a laptop or desktop computer with a stable internet connection.
  • High attention to detail and ability to follow strict linguistic and structural guidelines.
  • Comfortable working with LLM-generated content and chat-style datasets.
  • Bonus : prior experience in LLM evaluation or validation and data annotation projects, especially in linguistics.
  • Work Arrangements

  • Available for at least 5-8 hours per day, including on weekends when necessary. Flexible core work hours from 9 : 00 am - 6 : 00 pm.
  • Able to commit to the project from November 19th to November 30th, 2025.
  • 100% remote work opportunity.
  • Work from the comfort of your own home.
  • Be part of a forward-thinking AI enablement company in Malaysia.
  • Gain invaluable work experience on an AI solution that represents Malaysian languages and dialects.
  • Accelerate AI development with Chemin by training next-generation language models!

    #J-18808-Ljbffr

    Create a job alert for this search

    Data • Putrajaya, Putrajaya, Malaysia

    Related jobs
    Remote LLM Evaluator : English & Bahasa Malaysia

    Remote LLM Evaluator : English & Bahasa Malaysia

    Chemin • Puchong, Selangor, Malaysia
    A forward-thinking AI enablement company in Malaysia is seeking LLM Evaluators to validate AI-generated outputs.Candidates must be Malaysian citizens fluent in Bahasa Malaysia and English, with exc...Show more
    Last updated: 17 hours ago • Promoted • New!
    Join the Welo Data Network – Malay Speakers in Malaysia

    Join the Welo Data Network – Malay Speakers in Malaysia

    Welocalize, Inc. • Kajang Municipal Council, Selangor, Malaysia
    At Welo Data, we’re at the frontier of AI and localisation, providing high-quality language data that fuels smarter, more inclusive technologies. As part of the Welocalize family, we partner with le...Show more
    Last updated: 30+ days ago • Promoted
    Malay Translator

    Malay Translator

    RWS Group • Kajang Municipal Council, Selangor, Malaysia
    You will be responsible for delivering translations of the highest quality and accuracy, on time and within budget.You will act as lead translator for projects and accounts, performing tasks such a...Show more
    Last updated: 30+ days ago • Promoted
    Growth & Influencer Acquisition Analyst Kuala Lumpur, Malaysia

    Growth & Influencer Acquisition Analyst Kuala Lumpur, Malaysia

    avea-life.com • Kuala Lumpur, Kuala Lumpur, Malaysia
    Avea is a pioneering dietary supplement company committed to promoting longevity and wellbeing.Beyond our innovative supplements from our Swiss R&D, we're expanding our reach into the digital healt...Show more
    Last updated: 30+ days ago • Promoted
    Freelance Malay Translator

    Freelance Malay Translator

    RWS Group • Puchong, Selangor, Malaysia
    We are seeking a dedicated freelance English to Malay Translator to collaborate with one of our esteemed clients.This is a remote opportunity offering competitive remuneration for the right candida...Show more
    Last updated: 18 days ago • Promoted
    Freelance Luxury Brand Evaluator in Pahang, Malaysia

    Freelance Luxury Brand Evaluator in Pahang, Malaysia

    CXG group • Subang Jaya, Selangor, Malaysia
    Turn your passion for luxury into a career opportunity! Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles. Join CXG, the global leader in cust...Show more
    Last updated: 9 days ago • Promoted
    Localisation Specialist (Bahasa Malaysia)

    Localisation Specialist (Bahasa Malaysia)

    MVC Resources • Kuala Lumpur, 14, my
    Quick Apply
    Responsible for the localization work of various projects in Malaysia language (Bahasa Melayu), ensuring the delivery and quality of Bahasa Malaysia localization content. Monitor player feedback, fo...Show more
    Last updated: 9 days ago
    Become a Luxury Watch Brand Evaluator in Kuala Lumpur, Malaysia

    Become a Luxury Watch Brand Evaluator in Kuala Lumpur, Malaysia

    CXG group • Kuala Lumpur, Kuala Lumpur, Malaysia
    Turn your passion for fine timepieces into a rewarding freelance opportunity!.Explore the world of luxury watchmaking and make a lasting impact on some of the world’s most prestigious horology bran...Show more
    Last updated: 30+ days ago • Promoted
    Multilingual LLM Data Evaluator (Bahasa Melayu and English)

    Multilingual LLM Data Evaluator (Bahasa Melayu and English)

    Chemin • Subang Jaya, Selangor, Malaysia
    Chemin is partnering with a well-established enterprise with an innovation arm focused on emerging technologies, infrastructure, and AI-related initiatives. For this project, we are seeking individu...Show more
    Last updated: 9 days ago • Promoted
    Data & Integrations Developer – Malaysia

    Data & Integrations Developer – Malaysia

    PS Global Consulting • Kuala Lumpur, Kuala Lumpur, Malaysia
    Data & Integrations Developer - Malaysia.You will aid integration consultants in developing workflows & integrations based on customers’ requirements using low / no-code platforms, as well as provide...Show more
    Last updated: 26 days ago • Promoted
    Freelance Luxury Brand Evaluator Automotive Project in Kinablu, Sabah, Malaysia

    Freelance Luxury Brand Evaluator Automotive Project in Kinablu, Sabah, Malaysia

    CXG • Shah Alam, Shah Alam, Malaysia
    Are you a luxury automobile enthusiast who appreciates the finer details of high-end vehicles? If the answer is yes, we are looking for you!. As a Luxury Brand Evaluator, you will step into the worl...Show more
    Last updated: 30+ days ago • Promoted
    Malaysian Language Data Sourcing & Script Review Project

    Malaysian Language Data Sourcing & Script Review Project

    Freelancing • Kuala Lumpur, Kuala Lumpur, Malaysia
    Malaysian Language Data Sourcing & Script Review Project.URGENT) We are running a project in Malaysia that requires native Bahasa Malaysia speakers to support an AI‑driven call center script develo...Show more
    Last updated: 30+ days ago • Promoted
    Audio Data Collection & Transcription Project (Native English speakers in Malaysia) - Remote

    Audio Data Collection & Transcription Project (Native English speakers in Malaysia) - Remote

    TELUS Digital AI Data Solutions • Cyberjaya, Selangor, Malaysia
    Audio Data Collection & Transcription Project (Native English speakers in Malaysia) - Remote.Get AI-powered advice on this job and more exclusive features. Direct message the job poster from TELUS D...Show more
    Last updated: 5 days ago • Promoted
    Online Data Analyst - English speakers in Malaysia (Remote)

    Online Data Analyst - English speakers in Malaysia (Remote)

    TELUS Digital AI Data Solutions • Cyberjaya, Selangor, Malaysia
    Online Data Analyst - English speakers in Malaysia (Remote).Direct message the job poster from TELUS Digital AI Data Solutions. In this role, you will be working on a project aimed at enhancing the ...Show more
    Last updated: 30+ days ago • Promoted