Talent.com
Multilingual LLM Data Evaluator (Bahasa Melayu and English)
Multilingual LLM Data Evaluator (Bahasa Melayu and English)Chemin • Kulai, Johor, Malaysia
Multilingual LLM Data Evaluator (Bahasa Melayu and English)

Multilingual LLM Data Evaluator (Bahasa Melayu and English)

Chemin • Kulai, Johor, Malaysia
10 days ago
Job description

Chemin is partnering with a well-established enterprise with an innovation arm focused on emerging technologies, infrastructure, and AI-related initiatives. For this project, we are seeking individuals as LLM Evaluators who can read and write Bahasa Malaysia (BM) and English fluently.

You will evaluate AI-generated outputs by reviewing the response accuracy and reasoning or logic, using the chat history strictly as context. This role requires strong language skills, judgment, attention to detail, and the ability to identify logical, grammatical, and structural issues without altering the original meaning of outputs widely.

The key to your success is to ensure a high standard of excellence in performing validations, as quality is critical to enhancing AI models. Ultimately, alongside the Delivery Team at Chemin, you will shape how Malaysian languages are represented in the next generation of powerful large language models by refining a high volume and quality dataset.

  • Deliver precise validations of response outputs with minimal to no revisions.
  • Evaluate LLM prompts :

Ensure the response is accurate and aligned with the conversational context.

  • Verify that the reasoning supports the response logic.
  • Rewrite responses or reasoning where required, depending on the severity of issues.
  • Adapt text to sound natural in the service languages (Bahasa Malaysia and English), especially in cases where LLM outputs are affected by translation-related grammar errors.
  • Maintain the original meaning of the response output while improving sentence structure, grammar, and clarity for minor errors.
  • Discard data points with entirely illogical response outputs or reasoning, as these are unusable for AI training.
  • Proactively communicate challenges, queries, or concerns with Project Managers to ensure smooth operations.
  • Meet key deadlines while maintaining quality and consistency in work output.
  • Qualifications

  • Malaysian citizen fluent in English and Bahasa Melayu (reading and writing).
  • Able to evaluate logic, language clarity, and reasoning structure.
  • Capable of detecting unnatural language caused by machine translation and adapt it while maintaining meaning.
  • Attention to detail and a high level of accuracy in detecting errors in spelling, grammar, and conversation flow.
  • Efficient time management skills to meet and exceed daily deliverables.
  • Professional attitude : responsive and inquisitive to ask clarifying questions.
  • Possess a laptop or desktop computer with a stable internet connection.
  • High attention to detail and ability to follow strict linguistic and structural guidelines.
  • Comfortable working with LLM-generated content and chat-style datasets.
  • Bonus : prior experience in LLM evaluation or validation and data annotation projects, especially in linguistics.
  • Work Arrangements

  • Available for at least 5-8 hours per day, including on weekends when necessary. Flexible core work hours from 9 : 00 am - 6 : 00 pm.
  • Able to commit to the project from November 19th to November 30th, 2025.
  • 100% remote work opportunity.
  • Work from the comfort of your own home.
  • Be part of a forward-thinking AI enablement company in Malaysia.
  • Gain invaluable work experience on an AI solution that represents Malaysian languages and dialects.
  • Accelerate AI development with Chemin by training next-generation language models!

    #J-18808-Ljbffr

    Create a job alert for this search

    Data • Kulai, Johor, Malaysia

    Related jobs
    Hybrid ML Engineer - Diffusion & Vision (Remote-Friendly)

    Hybrid ML Engineer - Diffusion & Vision (Remote-Friendly)

    Bjak • Kulai, Johor, Malaysia
    A leading AI company in Malaysia seeks a Machine Learning Engineer to develop cutting-edge generative vision features.You'll customize diffusion models and build large-scale datasets while collabor...Show more
    Last updated: 4 days ago • Promoted
    Strategic Health Systems Sales Leader; Malaysia Country Lead

    Strategic Health Systems Sales Leader; Malaysia Country Lead

    Philips International • Kulai, Johor, Malaysia
    A global health technology leader is seeking a Health Systems Sales Leader and Country Manager for Malaysia.The candidate will be responsible for developing sales strategies, leading a team, and ma...Show more
    Last updated: 9 days ago • Promoted
    AI QA Trainer – LLM Evaluation

    AI QA Trainer – LLM Evaluation

    Invisible Expert Marketplace • Kulai, Johor, Malaysia
    AI QA Trainer – LLM Evaluation.Get AI-powered advice on this job and more exclusive features.Are you an AI QA expert eager to shape the future of AI? Large-scale language models are evolving from c...Show more
    Last updated: 30+ days ago • Promoted
    Freelance Luxury Brand Evaluator in Penang, Malaysia

    Freelance Luxury Brand Evaluator in Penang, Malaysia

    CXG group • Kulai, Johor, Malaysia
    Turn your passion for luxury into a career opportunity! Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles. Join CXG, the global leader in cust...Show more
    Last updated: 30+ days ago • Promoted
    LMS Data Analyst and EdTech Lead

    LMS Data Analyst and EdTech Lead

    Enko Education • Kulai, Johor, Malaysia
    Be among the first 25 applicants.Get AI-powered advice on this job and more exclusive features.Flexible - Preferably in Africa. Enko Education is on the lookout for a tech-savvy changemaker to lead ...Show more
    Last updated: 30+ days ago • Promoted
    English to Malay Translator

    English to Malay Translator

    Dataannotation • Kulai, Johor, Malaysia
    We are looking for a Remote Interpreter (Czech / English) to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve t...Show more
    Last updated: 30+ days ago • Promoted
    Data Center Operations Leader (ELV) — Regional Growth

    Data Center Operations Leader (ELV) — Regional Growth

    Agensi Pekerjaan Career Wise Sdn Bhd • Kulai, Johor, Malaysia
    A recruitment agency in Malaysia is seeking a sales and operations manager with expertise in the data center industry.The role involves achieving sales targets, managing client relations, and prepa...Show more
    Last updated: 7 days ago • Promoted
    Audio Data Collection & Transcription Project (Native English speakers in Malaysia) - Remote

    Audio Data Collection & Transcription Project (Native English speakers in Malaysia) - Remote

    TELUS Digital AI Data Solutions • Kulai, Johor, Malaysia
    Audio Data Collection & Transcription Project (Native English speakers in Malaysia) - Remote.Get AI-powered advice on this job and more exclusive features. Direct message the job poster from TELUS D...Show more
    Last updated: 6 days ago • Promoted
    Freelance Malay Translator

    Freelance Malay Translator

    RWS Group • Kulai, Johor, Malaysia
    We are seeking a dedicated freelance English to Malay Translator to collaborate with one of our esteemed clients.This is a remote opportunity offering competitive remuneration for the right candida...Show more
    Last updated: 19 days ago • Promoted
    Freelance Malay Interpreter

    Freelance Malay Interpreter

    ContacLink Solutions • Kulai, Johor, Malaysia
    As a remote interpreter, you play a significant role in facilitating communication between Malay and English speakers.The interpreter must process information quickly and accurately in a profession...Show more
    Last updated: 21 days ago • Promoted
    Machine Learning Engineer

    Machine Learning Engineer

    Second Talent • Kulai, Johor, Malaysia
    Member of Technical Staff - Environments (ML).As an Environment Engineer (ML), you will build on top of our core platform to create the simulation environments in which frontier coding agents learn...Show more
    Last updated: 19 days ago • Promoted
    Country Manager, Malaysia & Indonesia — AI & Enterprise Sales

    Country Manager, Malaysia & Indonesia — AI & Enterprise Sales

    Proto • Kulai, Johor, Malaysia
    A leading AI solutions provider is seeking a Country Manager to oversee operations in Malaysia and Indonesia.The role involves engaging with prospects, managing a sales pipeline, and leading presen...Show more
    Last updated: 4 days ago • Promoted
    Online Data Analyst - English speakers in Malaysia (Remote)

    Online Data Analyst - English speakers in Malaysia (Remote)

    TELUS Digital AI Data Solutions • Kulai, Johor, Malaysia
    Online Data Analyst - English speakers in Malaysia (Remote).Direct message the job poster from TELUS Digital AI Data Solutions. In this role, you will be working on a project aimed at enhancing the ...Show more
    Last updated: 30+ days ago • Promoted
    Become a Luxury Brand Evaluator Automobile Project in Selangor, Malaysia

    Become a Luxury Brand Evaluator Automobile Project in Selangor, Malaysia

    CXG • Kulai, Johor, Malaysia
    Become a Luxury Brand Evaluator Automobile Project in Selangor, Malaysia.Are you a luxury automobile enthusiast who appreciates the finer details of high-end vehicles? If the answer is yes, we are ...Show more
    Last updated: 30+ days ago • Promoted
    Freelance Luxury Brand Evaluator in Pahang, Malaysia

    Freelance Luxury Brand Evaluator in Pahang, Malaysia

    CXG group • Kulai, Johor, Malaysia
    Turn your passion for luxury into a career opportunity! Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles. Join CXG, the global leader in cust...Show more
    Last updated: 10 days ago • Promoted
    Malay Translator

    Malay Translator

    RWS Group • Kulai, Johor, Malaysia
    You will be responsible for delivering translations of the highest quality and accuracy, on time and within budget.You will act as lead translator for projects and accounts, performing tasks such a...Show more
    Last updated: 30+ days ago • Promoted
    Join the Welo Data Network – Malay Speakers in Malaysia

    Join the Welo Data Network – Malay Speakers in Malaysia

    Welocalize, Inc. • Kulai, Johor, Malaysia
    At Welo Data, we’re at the frontier of AI and localisation, providing high-quality language data that fuels smarter, more inclusive technologies. As part of the Welocalize family, we partner with le...Show more
    Last updated: 30+ days ago • Promoted
    Freelance Luxury Brand Evaluator in Johor Bahru, Malaysia

    Freelance Luxury Brand Evaluator in Johor Bahru, Malaysia

    CXG group • Kulai, Johor, Malaysia
    Turn your passion for luxury into a career opportunity! Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles. Join CXG, the global leader in cust...Show more
    Last updated: 30+ days ago • Promoted