Talent.com
Multilingual LLM Data Evaluator (Bahasa Melayu and English)

Multilingual LLM Data Evaluator (Bahasa Melayu and English)

CheminSubang Jaya, Subang Jaya, Malaysia
2 days ago
Job description

Chemin is partnering with a well-established enterprise with an innovation arm focused on emerging technologies, infrastructure, and AI-related initiatives. For this project, we are seeking individuals as LLM Evaluators who can read and write Bahasa Malaysia (BM) and English fluently.

You will evaluate AI-generated outputs by reviewing the response accuracy and reasoning or logic, using the chat history strictly as context. This role requires strong language skills, judgment, attention to detail, and the ability to identify logical, grammatical, and structural issues without altering the original meaning of outputs widely.

The key to your success is to ensure a high standard of excellence in performing validations, as quality is critical to enhancing AI models. Ultimately, alongside the Delivery Team at Chemin, you will shape how Malaysian languages are represented in the next generation of powerful large language models by refining a high volume and quality dataset.

  • Deliver precise validations of response outputs with minimal to no revisions.
  • Evaluate LLM prompts :

Ensure the response is accurate and aligned with the conversational context.

  • Verify that the reasoning supports the response logic.
  • Rewrite responses or reasoning where required, depending on the severity of issues.
  • Adapt text to sound natural in the service languages (Bahasa Malaysia and English), especially in cases where LLM outputs are affected by translation-related grammar errors.
  • Maintain the original meaning of the response output while improving sentence structure, grammar, and clarity for minor errors.
  • Discard data points with entirely illogical response outputs or reasoning, as these are unusable for AI training.
  • Proactively communicate challenges, queries, or concerns with Project Managers to ensure smooth operations.
  • Meet key deadlines while maintaining quality and consistency in work output.
  • Qualifications

  • Malaysian citizen fluent in English and Bahasa Melayu (reading and writing).
  • Able to evaluate logic, language clarity, and reasoning structure.
  • Capable of detecting unnatural language caused by machine translation and adapt it while maintaining meaning.
  • Attention to detail and a high level of accuracy in detecting errors in spelling, grammar, and conversation flow.
  • Efficient time management skills to meet and exceed daily deliverables.
  • Professional attitude : responsive and inquisitive to ask clarifying questions.
  • Possess a laptop or desktop computer with a stable internet connection.
  • High attention to detail and ability to follow strict linguistic and structural guidelines.
  • Comfortable working with LLM-generated content and chat-style datasets.
  • Bonus : prior experience in LLM evaluation or validation and data annotation projects, especially in linguistics.
  • Work Arrangements

  • Available for at least 5-8 hours per day, including on weekends when necessary. Flexible core work hours from 9 : 00 am - 6 : 00 pm.
  • Able to commit to the project from November 19th to November 30th, 2025.
  • 100% remote work opportunity.
  • Work from the comfort of your own home.
  • Be part of a forward-thinking AI enablement company in Malaysia.
  • Gain invaluable work experience on an AI solution that represents Malaysian languages and dialects.
  • Accelerate AI development with Chemin by training next-generation language models!

    #J-18808-Ljbffr

    Create a job alert for this search

    Data • Subang Jaya, Subang Jaya, Malaysia

    Related jobs
    • Promoted
    Remote Country Manager - Malaysia (iGaming Growth Leader)

    Remote Country Manager - Malaysia (iGaming Growth Leader)

    Ludicrum TechSelayang Municipal Council, Selayang Municipal Council, Malaysia
    A leading iGaming company is seeking a Country Manager for Malaysia to drive the growth of the GemBet brand.You will oversee operations, ensure regulatory compliance, and define growth strategies w...Show moreLast updated: 1 day ago
    • Promoted
    Business Development Manager (Malay)

    Business Development Manager (Malay)

    David Kennedy RecruitmentKlang, Selangor, Malaysia
    David Kennedy Recruitment is working with an award-winning multi-licensed, broker who offers online CFD trading on FX, crypto, oil, metals, shares, and indices and seeking to onboard a Business De...Show moreLast updated: 30+ days ago
    • Promoted
    Freelance Luxury Brand Evaluator in Pahang, Malaysia

    Freelance Luxury Brand Evaluator in Pahang, Malaysia

    CXG groupShah Alam, Shah Alam, Malaysia
    Turn your passion for luxury into a career opportunity! Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles. Join CXG, the global leader in cust...Show moreLast updated: 2 days ago
    Malay interpreter(Malaysia)

    Malay interpreter(Malaysia)

    AsialocalizeKuala Lumpur, Malaysia
    Quick Apply
    AsiaLocalize provides comprehensive translation and localization services to support clients in accessing and succeeding in global markets. With a wide range of professional native translators, expe...Show moreLast updated: 1 day ago
    • Promoted
    • New!
    Lead Talent Acquisition : Build World-Class Teams (Remote)

    Lead Talent Acquisition : Build World-Class Teams (Remote)

    BjakSelayang Municipal Council, Selayang Municipal Council, Malaysia
    A financial services platform in Malaysia seeks a Lead, Talent Acquisition to drive recruitment efforts.This role involves managing the full-cycle hiring process and ensuring a positive candidate e...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Asia Regional Site Management Leader (Remote)

    Asia Regional Site Management Leader (Remote)

    GE VernovaSeremban, Negeri Sembilan, Malaysia
    A leading energy company is seeking a Site Manager to oversee site management organization in Kuala Lumpur.The role includes ensuring successful execution of site projects, developing necessary pro...Show moreLast updated: 6 hours ago
    • Promoted
    Malay Translator

    Malay Translator

    RWS GroupKuala Lumpur, Kuala Lumpur, Malaysia
    You will be responsible for delivering translations of the highest quality and accuracy, on time and within budget.You will act as lead translator for projects and accounts, performing tasks such a...Show moreLast updated: 30+ days ago
    Localisation Specialist (Bahasa Malaysia)

    Localisation Specialist (Bahasa Malaysia)

    MVC ResourcesKuala Lumpur, 14, my
    Quick Apply
    Responsible for the localization work of various projects in Malaysia language (Bahasa Melayu), ensuring the delivery and quality of Bahasa Malaysia localization content. Monitor player feedback, fo...Show moreLast updated: 2 days ago
    • Promoted
    Strategic Health Systems Sales Leader; Malaysia Country Lead

    Strategic Health Systems Sales Leader; Malaysia Country Lead

    Philips InternationalNilai, Negeri Sembilan, Malaysia
    A global health technology leader is seeking a Health Systems Sales Leader and Country Manager for Malaysia.The candidate will be responsible for developing sales strategies, leading a team, and ma...Show moreLast updated: 1 day ago
    • Promoted
    Technical Solutions Architect II

    Technical Solutions Architect II

    Akamai Technologies GmbHSeremban, Negeri Sembilan, Malaysia
    Join the Technical Solutions Architect team.Akamai is working to simplify the way people work in the cloud.The team's mission is to accelerate innovation by making computing simple, scalable, acces...Show moreLast updated: 2 days ago
    • Promoted
    Talent Acquisition Partner - KL, Malaysia

    Talent Acquisition Partner - KL, Malaysia

    CygnifyKlang City, Selangor, Malaysia
    Talent Acquisition Partner - KL, Malaysia.Cygnify is a dynamic and innovative talent solutions provider specializing in Talent Acquisition as a Service (TAaaS) for technology start-ups across the r...Show moreLast updated: 2 days ago
    • Promoted
    Marketing Lead (Kuala Lumpur, Malaysia)

    Marketing Lead (Kuala Lumpur, Malaysia)

    WeshineKuala Lumpur, Kuala Lumpur, Malaysia
    Weshine, located in Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia.Weshine is hiring on behalf of our client,. Web3 entertainment and creator‑tech company based in Hong Kong.SoundBeats em...Show moreLast updated: 19 days ago
    • Promoted
    • New!
    B2B Growth Lead — Remote, Flexible Hours

    B2B Growth Lead — Remote, Flexible Hours

    SlasifySelayang Municipal Council, Selayang Municipal Council, Malaysia
    A rapidly growing technology company, Slasify, is seeking a highly skilled Business Development Manager to generate new business opportunities and maintain client relationships.This role offers the...Show moreLast updated: 6 hours ago
    Become a Luxury Watch Brand Evaluator in Kuala Lumpur, Malaysia

    Become a Luxury Watch Brand Evaluator in Kuala Lumpur, Malaysia

    CXGKuala Lumpur, Federal Territory of Kuala Lumpur, MY
    Quick Apply
    Turn your passion for fine timepieces into a rewarding freelance opportunity!.Explore the world of luxury watchmaking and make a lasting impact on some of the world’s most prestigious horology bran...Show moreLast updated: 30+ days ago
    • Promoted
    Malaysian Language Data Sourcing & Script Review Project

    Malaysian Language Data Sourcing & Script Review Project

    FreelancingKuala Lumpur, Kuala Lumpur, Malaysia
    Malaysian Language Data Sourcing & Script Review Project.URGENT) We are running a project in Malaysia that requires native Bahasa Malaysia speakers to support an AI‑driven call center script develo...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Remote German O2C Analyst — Collections & Cash

    Remote German O2C Analyst — Collections & Cash

    Danaher CorporationSeremban, Negeri Sembilan, Malaysia
    A global technology company in Kuala Lumpur is seeking an O2C Analyst with fluency in German to manage collection activities. The role involves supporting timely customer payments, stakeholder engag...Show moreLast updated: 6 hours ago
    • Promoted
    Multilingual LLM Data Evaluator (Bahasa Melayu and English)

    Multilingual LLM Data Evaluator (Bahasa Melayu and English)

    CheminNilai, Negeri Sembilan, Malaysia
    Chemin is partnering with a well-established enterprise with an innovation arm focused on emerging technologies, infrastructure, and AI-related initiatives. For this project, we are seeking individu...Show moreLast updated: 2 days ago
    AI Service (Malay- English)

    AI Service (Malay- English)

    AsialocalizeKuala Lumpur, Malaysia
    We have an on-device speech-to-text (STT) model huge project and are currently sourcing large-scale Manglish (MalayEnglish code-switch). We are interested in exploring a partnership with your organi...Show moreLast updated: 30+ days ago