Talent.com
No longer accepting applications
Multilingual LLM Data Evaluator (Bahasa Melayu and English)

Multilingual LLM Data Evaluator (Bahasa Melayu and English)

CheminPasir Gudang, Johor, Malaysia
4 days ago
Job description

Chemin is partnering with a well-established enterprise with an innovation arm focused on emerging technologies, infrastructure, and AI-related initiatives. For this project, we are seeking individuals as LLM Evaluators who can read and write Bahasa Malaysia (BM) and English fluently.

You will evaluate AI-generated outputs by reviewing the response accuracy and reasoning or logic, using the chat history strictly as context. This role requires strong language skills, judgment, attention to detail, and the ability to identify logical, grammatical, and structural issues without altering the original meaning of outputs widely.

The key to your success is to ensure a high standard of excellence in performing validations, as quality is critical to enhancing AI models. Ultimately, alongside the Delivery Team at Chemin, you will shape how Malaysian languages are represented in the next generation of powerful large language models by refining a high volume and quality dataset.

  • Deliver precise validations of response outputs with minimal to no revisions.
  • Evaluate LLM prompts :

Ensure the response is accurate and aligned with the conversational context.

  • Verify that the reasoning supports the response logic.
  • Rewrite responses or reasoning where required, depending on the severity of issues.
  • Adapt text to sound natural in the service languages (Bahasa Malaysia and English), especially in cases where LLM outputs are affected by translation-related grammar errors.
  • Maintain the original meaning of the response output while improving sentence structure, grammar, and clarity for minor errors.
  • Discard data points with entirely illogical response outputs or reasoning, as these are unusable for AI training.
  • Proactively communicate challenges, queries, or concerns with Project Managers to ensure smooth operations.
  • Meet key deadlines while maintaining quality and consistency in work output.
  • Qualifications

  • Malaysian citizen fluent in English and Bahasa Melayu (reading and writing).
  • Able to evaluate logic, language clarity, and reasoning structure.
  • Capable of detecting unnatural language caused by machine translation and adapt it while maintaining meaning.
  • Attention to detail and a high level of accuracy in detecting errors in spelling, grammar, and conversation flow.
  • Efficient time management skills to meet and exceed daily deliverables.
  • Professional attitude : responsive and inquisitive to ask clarifying questions.
  • Possess a laptop or desktop computer with a stable internet connection.
  • High attention to detail and ability to follow strict linguistic and structural guidelines.
  • Comfortable working with LLM-generated content and chat-style datasets.
  • Bonus : prior experience in LLM evaluation or validation and data annotation projects, especially in linguistics.
  • Work Arrangements

  • Available for at least 5-8 hours per day, including on weekends when necessary. Flexible core work hours from 9 : 00 am - 6 : 00 pm.
  • Able to commit to the project from November 19th to November 30th, 2025.
  • 100% remote work opportunity.
  • Work from the comfort of your own home.
  • Be part of a forward-thinking AI enablement company in Malaysia.
  • Gain invaluable work experience on an AI solution that represents Malaysian languages and dialects.
  • Accelerate AI development with Chemin by training next-generation language models!

    #J-18808-Ljbffr

    Create a job alert for this search

    Data • Pasir Gudang, Johor, Malaysia

    Related jobs
    • Promoted
    • New!
    Senior Data & Machine Learning Engineer

    Senior Data & Machine Learning Engineer

    HIOKI SINGAPORE PTE. LTD.Serangoon Garden Circus, Southeast, Singapore
    Help build a modern data foundation that turns high‑rate, time‑indexed information into reliable, customer‑facing insight across workstation and distributed environments. You’ll sit at the intersect...Show moreLast updated: 2 hours ago
    • Promoted
    Freelance Luxury Brand Evaluator in Pahang, Malaysia

    Freelance Luxury Brand Evaluator in Pahang, Malaysia

    CXG groupIskandar Puteri, Johor, Malaysia
    Turn your passion for luxury into a career opportunity! Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles. Join CXG, the global leader in cust...Show moreLast updated: 4 days ago
    • Promoted
    AI Evaluator - Cantonese (Chinese) - Malaysia

    AI Evaluator - Cantonese (Chinese) - Malaysia

    CrowdGen by AppenGelang Patah, Johor, Malaysia
    Join CrowdGen as we launch an exciting new AI Voice Interaction Project designed to help improve the way voice assistants understand and respond to users! We’re looking for detail-oriented contribu...Show moreLast updated: 6 days ago
    Malay interpreter(Malaysia)

    Malay interpreter(Malaysia)

    AsialocalizeJohor, Malaysia
    Quick Apply
    AsiaLocalize provides comprehensive translation and localization services to support clients in accessing and succeeding in global markets. With a wide range of professional native translators, expe...Show moreLast updated: 3 days ago
    • Promoted
    Machine Learning Engineer

    Machine Learning Engineer

    HIOKI SINGAPORE PTE. LTD.Serangoon Garden Circus, Southeast, Singapore
    Design, train, and validate models that detect anomalies and forecast health from multivariate, time‑indexed signals.Optimize and package models for constrained environments (quantization, pruning,...Show moreLast updated: 1 day ago
    • Promoted
    Remote AI Task Evaluation & Analytics Specialist

    Remote AI Task Evaluation & Analytics Specialist

    MercorWorkFromHome, Singapore, Singapore
    Remote
    A leading AI research consulting firm is seeking a part-time AI Task Evaluation & Statistical Analysis Specialist to conduct statistical failure analysis and recommend design improvements based on ...Show moreLast updated: 4 days ago
    • Promoted
    Online Data Analyst - English speakers in Malaysia (Remote)

    Online Data Analyst - English speakers in Malaysia (Remote)

    TELUS Digital AI Data SolutionsIskandar Puteri, Johor, Malaysia
    Online Data Analyst - English speakers in Malaysia (Remote).Direct message the job poster from TELUS Digital AI Data Solutions. In this role, you will be working on a project aimed at enhancing the ...Show moreLast updated: 30+ days ago
    • Promoted
    Remote Multilingual Live-Chat Agent

    Remote Multilingual Live-Chat Agent

    AlphaiotabpoJohor Bahru, Johor, Malaysia
    A leading customer service provider in Kuala Lumpur is seeking a customer service representative to enhance customer satisfaction through live chats. Ideal candidates must have at least 1 year of ex...Show moreLast updated: 3 days ago
    • Promoted
    • New!
    Remote Data Science Lead for Institutional Analytics & ML

    Remote Data Science Lead for Institutional Analytics & ML

    CobaltWorkFromHome, Singapore, Singapore
    Remote
    A leading blockchain intelligence firm is seeking a Mid-Senior level Data Scientist to build and lead their data science organization. You'll own the analytics lifecycle, drive impactful solutions, ...Show moreLast updated: 2 hours ago
    • Promoted
    Remote AI Software Engineer — ML Lifecycle Lead

    Remote AI Software Engineer — ML Lifecycle Lead

    BJAKWorkFromHome, Singapore, Singapore
    Remote
    A leading insurance platform in Southeast Asia seeks a Machine Learning Engineer to develop AI models and collaborate with international teams. This full-time position offers remote work in Singapor...Show moreLast updated: 2 days ago
    • Promoted
    Generative AI Engineer — Vision & NLP (Remote)

    Generative AI Engineer — Vision & NLP (Remote)

    LinhWorkFromHome, Singapore, Singapore
    Remote
    A leading Generative AI Start-up is seeking an ML Engineer to join their dynamic engineering team in Singapore.This role involves developing AI solutions and collaborating on machine learning proje...Show moreLast updated: 4 days ago
    • Promoted
    Remote Senior ML Platform Engineer — AI Infra

    Remote Senior ML Platform Engineer — AI Infra

    AtlassianWorkFromHome, Singapore, Singapore
    Remote
    A leading software company in Singapore is seeking a Senior ML System Engineer to develop and refine AI and Machine Learning infrastructure. The role involves collaboration with product teams to sol...Show moreLast updated: 3 days ago
    • Promoted
    • New!
    Audio Data Collection & Transcription Project (Native English speakers in Malaysia) - Remote

    Audio Data Collection & Transcription Project (Native English speakers in Malaysia) - Remote

    TELUS Digital AI Data SolutionsIskandar Puteri, Johor, Malaysia
    Audio Data Collection & Transcription Project (Native English speakers in Malaysia) - Remote.Get AI-powered advice on this job and more exclusive features. Direct message the job poster from TELUS D...Show moreLast updated: 4 hours ago
    • Promoted
    Data Center Operations Leader (ELV) — Regional Growth

    Data Center Operations Leader (ELV) — Regional Growth

    Agensi Pekerjaan Career Wise Sdn BhdKulai, Johor, Malaysia
    A recruitment agency in Malaysia is seeking a sales and operations manager with expertise in the data center industry.The role involves achieving sales targets, managing client relations, and prepa...Show moreLast updated: 1 day ago
    ML integration Engineer

    ML integration Engineer

    Unison GroupSingapore, Singapore, SG
    Quick Apply
    Generative and Agentic AI applications.Integrate AI models into production environments using containerized platforms such as . AI workflows and translate them into robust engineering solutions...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Technical Solutions Engineer (Remote in the APAC Region)

    Technical Solutions Engineer (Remote in the APAC Region)

    GetfilecloudPasir Gudang, Johor, Malaysia
    Technical Solutions Engineer – APAC Region (Philippines, Indonesia, Malaysia or Vietnam).FileCloud is looking for a passionate. Technical Solutions Engineer in the APAC Region (Philippines, Indonesi...Show moreLast updated: 4 hours ago
    • Promoted
    Remote Yemeni Arabic AI Language Trainer

    Remote Yemeni Arabic AI Language Trainer

    Invisible Expert MarketplaceGelang Patah, Johor, Malaysia
    An innovative AI training company seeks an Arabic (Yemeni) Language Expert to train AI models.This remote contract role requires expertise in phonetics, morphology, and syntax, alongside a Master’s...Show moreLast updated: 3 days ago
    • Promoted
    • New!
    Remote Clinical Specialist - Psych Rater (Malay)

    Remote Clinical Specialist - Psych Rater (Malay)

    IQVIAPasir Gudang, Johor, Malaysia
    A leading global provider of clinical research services is seeking a Clinical Trial Psych Rater to review scales in a clinical trial. The role involves ensuring standardized assessments, evaluating ...Show moreLast updated: 4 hours ago