Talent.com
Multilingual LLM Data Evaluator (Bahasa Melayu and English)
Multilingual LLM Data Evaluator (Bahasa Melayu and English)Chemin • Selayang Municipal Council, Selayang Municipal Council, Malaysia
Multilingual LLM Data Evaluator (Bahasa Melayu and English)

Multilingual LLM Data Evaluator (Bahasa Melayu and English)

Chemin • Selayang Municipal Council, Selayang Municipal Council, Malaysia
9 days ago
Job description

Chemin is partnering with a well-established enterprise with an innovation arm focused on emerging technologies, infrastructure, and AI-related initiatives. For this project, we are seeking individuals as LLM Evaluators who can read and write Bahasa Malaysia (BM) and English fluently.

You will evaluate AI-generated outputs by reviewing the response accuracy and reasoning or logic, using the chat history strictly as context. This role requires strong language skills, judgment, attention to detail, and the ability to identify logical, grammatical, and structural issues without altering the original meaning of outputs widely.

The key to your success is to ensure a high standard of excellence in performing validations, as quality is critical to enhancing AI models. Ultimately, alongside the Delivery Team at Chemin, you will shape how Malaysian languages are represented in the next generation of powerful large language models by refining a high volume and quality dataset.

  • Deliver precise validations of response outputs with minimal to no revisions.
  • Evaluate LLM prompts :

Ensure the response is accurate and aligned with the conversational context.

  • Verify that the reasoning supports the response logic.
  • Rewrite responses or reasoning where required, depending on the severity of issues.
  • Adapt text to sound natural in the service languages (Bahasa Malaysia and English), especially in cases where LLM outputs are affected by translation-related grammar errors.
  • Maintain the original meaning of the response output while improving sentence structure, grammar, and clarity for minor errors.
  • Discard data points with entirely illogical response outputs or reasoning, as these are unusable for AI training.
  • Proactively communicate challenges, queries, or concerns with Project Managers to ensure smooth operations.
  • Meet key deadlines while maintaining quality and consistency in work output.
  • Qualifications

  • Malaysian citizen fluent in English and Bahasa Melayu (reading and writing).
  • Able to evaluate logic, language clarity, and reasoning structure.
  • Capable of detecting unnatural language caused by machine translation and adapt it while maintaining meaning.
  • Attention to detail and a high level of accuracy in detecting errors in spelling, grammar, and conversation flow.
  • Efficient time management skills to meet and exceed daily deliverables.
  • Professional attitude : responsive and inquisitive to ask clarifying questions.
  • Possess a laptop or desktop computer with a stable internet connection.
  • High attention to detail and ability to follow strict linguistic and structural guidelines.
  • Comfortable working with LLM-generated content and chat-style datasets.
  • Bonus : prior experience in LLM evaluation or validation and data annotation projects, especially in linguistics.
  • Work Arrangements

  • Available for at least 5-8 hours per day, including on weekends when necessary. Flexible core work hours from 9 : 00 am - 6 : 00 pm.
  • Able to commit to the project from November 19th to November 30th, 2025.
  • 100% remote work opportunity.
  • Work from the comfort of your own home.
  • Be part of a forward-thinking AI enablement company in Malaysia.
  • Gain invaluable work experience on an AI solution that represents Malaysian languages and dialects.
  • Accelerate AI development with Chemin by training next-generation language models!

    #J-18808-Ljbffr

    Create a job alert for this search

    Data • Selayang Municipal Council, Selayang Municipal Council, Malaysia

    Related jobs
    Become a Luxury Brand Evaluator Automobile Project in Selangor, Malaysia

    Become a Luxury Brand Evaluator Automobile Project in Selangor, Malaysia

    CXG • Selayang Municipal Council, Selayang Municipal Council, Malaysia
    Become a Luxury Brand Evaluator Automobile Project in Selangor, Malaysia.Are you a luxury automobile enthusiast who appreciates the finer details of high-end vehicles? If the answer is yes, we are ...Show more
    Last updated: 30+ days ago • Promoted
    English to Malay Translator

    English to Malay Translator

    Dataannotation • Selayang Municipal Council, Selayang Municipal Council, Malaysia
    We are looking for a Remote Interpreter (Czech / English) to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve t...Show more
    Last updated: 30+ days ago • Promoted
    Hybrid ML Engineer - Diffusion & Vision (Remote-Friendly)

    Hybrid ML Engineer - Diffusion & Vision (Remote-Friendly)

    Bjak • Selayang Municipal Council, Selayang Municipal Council, Malaysia
    A leading AI company in Malaysia seeks a Machine Learning Engineer to develop cutting-edge generative vision features.You'll customize diffusion models and build large-scale datasets while collabor...Show more
    Last updated: 3 days ago • Promoted
    Experienced Malay Interpreter

    Experienced Malay Interpreter

    AsiaLocalize • Selayang Municipal Council, Selayang Municipal Council, Malaysia
    AsiaLocalize provides comprehensive translation and localization services to support clients in accessing and succeeding in global markets. With a wide range of professional native translators, expe...Show more
    Last updated: 30+ days ago • Promoted
    Become a Luxury Watch Brand Evaluator in Kota Kinablu, Malaysia

    Become a Luxury Watch Brand Evaluator in Kota Kinablu, Malaysia

    CXG • Selayang Municipal Council, Selayang Municipal Council, Malaysia
    Turn your passion for fine timepieces into a rewarding freelance opportunity!.Explore the world of luxury watchmaking and make a lasting impact on some of the world’s most prestigious horology bran...Show more
    Last updated: 30+ days ago • Promoted
    Machine Learning Engineer

    Machine Learning Engineer

    Second Talent • Selayang Municipal Council, Selayang Municipal Council, Malaysia
    Member of Technical Staff - Environments (ML).As an Environment Engineer (ML), you will build on top of our core platform to create the simulation environments in which frontier coding agents learn...Show more
    Last updated: 18 days ago • Promoted
    Freelance Luxury Brand Evaluator in Pahang, Malaysia

    Freelance Luxury Brand Evaluator in Pahang, Malaysia

    CXG group • Selayang Municipal Council, Selayang Municipal Council, Malaysia
    Turn your passion for luxury into a career opportunity! Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles. Join CXG, the global leader in cust...Show more
    Last updated: 9 days ago • Promoted
    Online Data Analyst - English speakers in Malaysia (Remote)

    Online Data Analyst - English speakers in Malaysia (Remote)

    TELUS Digital AI Data Solutions • Selayang Municipal Council, Selayang Municipal Council, Malaysia
    Online Data Analyst - English speakers in Malaysia (Remote).Direct message the job poster from TELUS Digital AI Data Solutions. In this role, you will be working on a project aimed at enhancing the ...Show more
    Last updated: 30+ days ago • Promoted
    Join the Welo Data Network – Malay Speakers in Malaysia

    Join the Welo Data Network – Malay Speakers in Malaysia

    Welocalize, Inc. • Selayang Municipal Council, Selayang Municipal Council, Malaysia
    At Welo Data, we’re at the frontier of AI and localisation, providing high-quality language data that fuels smarter, more inclusive technologies. As part of the Welocalize family, we partner with le...Show more
    Last updated: 30+ days ago • Promoted
    Audio Data Collection & Transcription Project (Native English speakers in Malaysia) - Remote

    Audio Data Collection & Transcription Project (Native English speakers in Malaysia) - Remote

    TELUS Digital AI Data Solutions • Selayang Municipal Council, Selayang Municipal Council, Malaysia
    Audio Data Collection & Transcription Project (Native English speakers in Malaysia) - Remote.Get AI-powered advice on this job and more exclusive features. Direct message the job poster from TELUS D...Show more
    Last updated: 5 days ago • Promoted
    AI QA Trainer – LLM Evaluation

    AI QA Trainer – LLM Evaluation

    Invisible Expert Marketplace • Selayang Municipal Council, Selayang Municipal Council, Malaysia
    AI QA Trainer – LLM Evaluation.Get AI-powered advice on this job and more exclusive features.Are you an AI QA expert eager to shape the future of AI? Large-scale language models are evolving from c...Show more
    Last updated: 30+ days ago • Promoted
    Freelance Malay Interpreter

    Freelance Malay Interpreter

    ContacLink Solutions • Selayang Municipal Council, Selayang Municipal Council, Malaysia
    As a remote interpreter, you play a significant role in facilitating communication between Malay and English speakers.The interpreter must process information quickly and accurately in a profession...Show more
    Last updated: 19 days ago • Promoted
    Strategic Health Systems Sales Leader; Malaysia Country Lead

    Strategic Health Systems Sales Leader; Malaysia Country Lead

    Philips International • Selayang Municipal Council, Selayang Municipal Council, Malaysia
    A global health technology leader is seeking a Health Systems Sales Leader and Country Manager for Malaysia.The candidate will be responsible for developing sales strategies, leading a team, and ma...Show more
    Last updated: 8 days ago • Promoted
    Freelance Luxury Brand Evaluator in Penang, Malaysia

    Freelance Luxury Brand Evaluator in Penang, Malaysia

    CXG group • Selayang Municipal Council, Selayang Municipal Council, Malaysia
    Turn your passion for luxury into a career opportunity! Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles. Join CXG, the global leader in cust...Show more
    Last updated: 30+ days ago • Promoted
    Freelance Luxury Brand Evaluator in Johor Bahru, Malaysia

    Freelance Luxury Brand Evaluator in Johor Bahru, Malaysia

    CXG group • Selayang Municipal Council, Selayang Municipal Council, Malaysia
    Turn your passion for luxury into a career opportunity! Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles. Join CXG, the global leader in cust...Show more
    Last updated: 30+ days ago • Promoted
    LMS Data Analyst and EdTech Lead

    LMS Data Analyst and EdTech Lead

    Enko Education • Selayang Municipal Council, Selayang Municipal Council, Malaysia
    Be among the first 25 applicants.Get AI-powered advice on this job and more exclusive features.Flexible - Preferably in Africa. Enko Education is on the lookout for a tech-savvy changemaker to lead ...Show more
    Last updated: 30+ days ago • Promoted
    Malay Translator

    Malay Translator

    RWS Group • Selayang Municipal Council, Selayang Municipal Council, Malaysia
    You will be responsible for delivering translations of the highest quality and accuracy, on time and within budget.You will act as lead translator for projects and accounts, performing tasks such a...Show more
    Last updated: 30+ days ago • Promoted
    Freelance Malay Translator

    Freelance Malay Translator

    RWS Group • Selayang Municipal Council, Selayang Municipal Council, Malaysia
    We are seeking a dedicated freelance English to Malay Translator to collaborate with one of our esteemed clients.This is a remote opportunity offering competitive remuneration for the right candida...Show more
    Last updated: 18 days ago • Promoted