Talent.com
Multilingual LLM Data Evaluator (Bahasa Melayu and English)

Multilingual LLM Data Evaluator (Bahasa Melayu and English)

CheminKulai, Johor, Malaysia
11 hours ago
Job description

Chemin is partnering with a well-established enterprise with an innovation arm focused on emerging technologies, infrastructure, and AI-related initiatives. For this project, we are seeking individuals as LLM Evaluators who can read and write Bahasa Malaysia (BM) and English fluently.

You will evaluate AI-generated outputs by reviewing the response accuracy and reasoning or logic, using the chat history strictly as context. This role requires strong language skills, judgment, attention to detail, and the ability to identify logical, grammatical, and structural issues without altering the original meaning of outputs widely.

The key to your success is to ensure a high standard of excellence in performing validations, as quality is critical to enhancing AI models. Ultimately, alongside the Delivery Team at Chemin, you will shape how Malaysian languages are represented in the next generation of powerful large language models by refining a high volume and quality dataset.

  • Deliver precise validations of response outputs with minimal to no revisions.
  • Evaluate LLM prompts :

Ensure the response is accurate and aligned with the conversational context.

  • Verify that the reasoning supports the response logic.
  • Rewrite responses or reasoning where required, depending on the severity of issues.
  • Adapt text to sound natural in the service languages (Bahasa Malaysia and English), especially in cases where LLM outputs are affected by translation-related grammar errors.
  • Maintain the original meaning of the response output while improving sentence structure, grammar, and clarity for minor errors.
  • Discard data points with entirely illogical response outputs or reasoning, as these are unusable for AI training.
  • Proactively communicate challenges, queries, or concerns with Project Managers to ensure smooth operations.
  • Meet key deadlines while maintaining quality and consistency in work output.
  • Qualifications

  • Malaysian citizen fluent in English and Bahasa Melayu (reading and writing).
  • Able to evaluate logic, language clarity, and reasoning structure.
  • Capable of detecting unnatural language caused by machine translation and adapt it while maintaining meaning.
  • Attention to detail and a high level of accuracy in detecting errors in spelling, grammar, and conversation flow.
  • Efficient time management skills to meet and exceed daily deliverables.
  • Professional attitude : responsive and inquisitive to ask clarifying questions.
  • Possess a laptop or desktop computer with a stable internet connection.
  • High attention to detail and ability to follow strict linguistic and structural guidelines.
  • Comfortable working with LLM-generated content and chat-style datasets.
  • Bonus : prior experience in LLM evaluation or validation and data annotation projects, especially in linguistics.
  • Work Arrangements

  • Available for at least 5-8 hours per day, including on weekends when necessary. Flexible core work hours from 9 : 00 am - 6 : 00 pm.
  • Able to commit to the project from November 19th to November 30th, 2025.
  • 100% remote work opportunity.
  • Work from the comfort of your own home.
  • Be part of a forward-thinking AI enablement company in Malaysia.
  • Gain invaluable work experience on an AI solution that represents Malaysian languages and dialects.
  • Accelerate AI development with Chemin by training next-generation language models!

    #J-18808-Ljbffr

    Create a job alert for this search

    Data • Kulai, Johor, Malaysia

    Related jobs
    • Promoted
    • New!
    Multilingual LLM Data Evaluator (Bahasa Melayu and English)

    Multilingual LLM Data Evaluator (Bahasa Melayu and English)

    CheminIskandar Puteri, Johor, Malaysia
    Chemin is partnering with a well-established enterprise with an innovation arm focused on emerging technologies, infrastructure, and AI-related initiatives. For this project, we are seeking individu...Show moreLast updated: 11 hours ago
    • Promoted
    • New!
    Senior ML Engineer — Scalable ML Pipelines & Deployment

    Senior ML Engineer — Scalable ML Pipelines & Deployment

    SAPWorkFromHome, Singapore, Singapore
    A leading cloud software provider in Singapore is looking for a Senior Machine Learning Engineer to design and implement scalable data pipelines, ensuring high-quality machine learning workflows.Th...Show moreLast updated: 13 hours ago
    • Promoted
    • New!
    Remote AI Task Evaluation & Analytics Specialist

    Remote AI Task Evaluation & Analytics Specialist

    MercorWorkFromHome, Singapore, Singapore
    Remote
    A leading AI research consulting firm is seeking a part-time AI Task Evaluation & Statistical Analysis Specialist to conduct statistical failure analysis and recommend design improvements based on ...Show moreLast updated: 13 hours ago
    • Promoted
    • New!
    Talent Acquisition Partner - KL, Malaysia

    Talent Acquisition Partner - KL, Malaysia

    CygnifyKulai, Johor, Malaysia
    Talent Acquisition Partner - KL, Malaysia.Cygnify is a dynamic and innovative talent solutions provider specializing in Talent Acquisition as a Service (TAaaS) for technology start-ups across the r...Show moreLast updated: 11 hours ago
    • Promoted
    Online Data Analyst - English speakers in Malaysia (Remote)

    Online Data Analyst - English speakers in Malaysia (Remote)

    TELUS Digital AI Data SolutionsIskandar Puteri, Johor, Malaysia
    Online Data Analyst - English speakers in Malaysia (Remote).Direct message the job poster from TELUS Digital AI Data Solutions. In this role, you will be working on a project aimed at enhancing the ...Show moreLast updated: 30+ days ago
    • Promoted
    Armenian Language Expert - AI Trainer

    Armenian Language Expert - AI Trainer

    Invisible Expert MarketplacePasir Gudang, Johor, Malaysia
    Armenian Language Expert – AI Trainer.Are you an Armenian language expert eager to shape the future of AI? Large‑scale language models are evolving from clever chatbots into powerful tools for comm...Show moreLast updated: 30+ days ago
    • Promoted
    Safety & Environmental Officer | Ulu Tiram

    Safety & Environmental Officer | Ulu Tiram

    Hirehub ManagementUlu Tiram, Johor, Malaysia
    The company specializes in the.Their expertise extends to providing comprehensive trading services, advanced engineering work, and precision sub-assembly solutions. Committed to innovation and excel...Show moreLast updated: 30+ days ago
    • Promoted
    AMEA MTI & Manufacturing Digitalization Lead

    AMEA MTI & Manufacturing Digitalization Lead

    Mondelēz InternationalPontian, Johor, Malaysia
    This position is accountable for delivering in-region manufacturing application planning, implementation and change management with excellence and in partnership with plant, regional and global sta...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Generative AI Engineer — Vision & NLP (Remote)

    Generative AI Engineer — Vision & NLP (Remote)

    LinhWorkFromHome, Singapore, Singapore
    Remote
    A leading Generative AI Start-up is seeking an ML Engineer to join their dynamic engineering team in Singapore.This role involves developing AI solutions and collaborating on machine learning proje...Show moreLast updated: 13 hours ago
    ML integration Engineer

    ML integration Engineer

    Unison Consulting Pte LtdSingapore, Singapore, SG
    Quick Apply
    Generative and Agentic AI applications.Integrate AI models into production environments using containerized platforms such as . AI workflows and translate them into robust engineering solutions...Show moreLast updated: 30+ days ago
    • Promoted
    MLOps Engineer (Remote)

    MLOps Engineer (Remote)

    BjakWorkFromHome, Singapore, Singapore
    Remote
    Transform Language Models into Real-World Applications.We’re building AI systems for a global audience.We are living in an era of AI transition – this new project team will be focusing on building ...Show moreLast updated: 1 day ago
    • Promoted
    Software Test Engineer (Kuala Lumpur, Malaysia)

    Software Test Engineer (Kuala Lumpur, Malaysia)

    WeshineKulai, Johor, Malaysia
    Weshine is hiring for our client (ESGpedia Singapore Pte Ltd), based in Singapore, for a digital remote role.ESGpedia Singapore Pte Ltd is Asia's leading ESG FinTech, underpinning the Monetary Auth...Show moreLast updated: 5 days ago
    • Promoted
    AI Data Specialist - Chinese

    AI Data Specialist - Chinese

    RWS GroupKulai, Johor, Malaysia
    AI Data Specialist - Chinese (Remote).We are looking for an AI Data Specialist to support the improvement of AI-generated content in English. This is a freelance, part‑time role based remotely with ...Show moreLast updated: 18 days ago
    • Promoted
    Field Officer – Loan Recovery (Penang / Johor) (ID : 12440)

    Field Officer – Loan Recovery (Penang / Johor) (ID : 12440)

    PERSOLKELLY Workforce Solutions Malaysia Sdn BhdBandar Permas, Johor, Malaysia
    Field Officer – Loan Recovery (Penang / Johor) (ID : 12440).PERSOLKELLY Workforce Solutions Malaysia Sdn Bhd.Kuala Lumpur City Centre, Kuala Lumpur. Monday to Friday : 8 : 45am to 5 : 45pm.Minimum Passed SP...Show moreLast updated: 13 days ago
    AI Research Lead LLM & Multimodal PostTraining

    AI Research Lead LLM & Multimodal PostTraining

    Tether Operations LimitedSingapore, 01, SG
    Join Tether and Shape the Future of Digital Finance.At Tether, we’re not just building products, we’re pioneering a global financial revolution. Our cutting-edge solutions empower businesses—from ex...Show moreLast updated: 17 days ago
    • Promoted
    • New!
    Freelance Luxury Brand Evaluator in Pahang, Malaysia

    Freelance Luxury Brand Evaluator in Pahang, Malaysia

    CXG groupKulai, Johor, Malaysia
    Turn your passion for luxury into a career opportunity! Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles. Join CXG, the global leader in cust...Show moreLast updated: 11 hours ago
    Machine Learning Integration Engineer

    Machine Learning Integration Engineer

    Unison Consulting Pte LtdSingapore, Singapore, SG
    Quick Apply
    You will work closely with data scientists, architects, and DevOps teams to design, implement, and optimize AI pipelines and infrastructure. Generative and Agentic AI applications.Integrate AI model...Show moreLast updated: 30+ days ago
    • Promoted
    Voice Talent Required - Malay

    Voice Talent Required - Malay

    LILT AIPasir Gudang, Johor, Malaysia
    Join to apply for the Voice Talent Required - Malay role at LILT AI.AI is changing how the world communicates — and LILT is leading that transformation. We're on a mission to make the world's inform...Show moreLast updated: 30+ days ago