Talent.com
Multilingual LLM Data Evaluator (Bahasa Melayu and English)

Multilingual LLM Data Evaluator (Bahasa Melayu and English)

CheminIpoh, Perak, Malaysia
10 jam yang lalu
Penerangan pekerjaan

Chemin is partnering with a well-established enterprise with an innovation arm focused on emerging technologies, infrastructure, and AI-related initiatives. For this project, we are seeking individuals as LLM Evaluators who can read and write Bahasa Malaysia (BM) and English fluently.

You will evaluate AI-generated outputs by reviewing the response accuracy and reasoning or logic, using the chat history strictly as context. This role requires strong language skills, judgment, attention to detail, and the ability to identify logical, grammatical, and structural issues without altering the original meaning of outputs widely.

The key to your success is to ensure a high standard of excellence in performing validations, as quality is critical to enhancing AI models. Ultimately, alongside the Delivery Team at Chemin, you will shape how Malaysian languages are represented in the next generation of powerful large language models by refining a high volume and quality dataset.

  • Deliver precise validations of response outputs with minimal to no revisions.
  • Evaluate LLM prompts :

Ensure the response is accurate and aligned with the conversational context.

  • Verify that the reasoning supports the response logic.
  • Rewrite responses or reasoning where required, depending on the severity of issues.
  • Adapt text to sound natural in the service languages (Bahasa Malaysia and English), especially in cases where LLM outputs are affected by translation-related grammar errors.
  • Maintain the original meaning of the response output while improving sentence structure, grammar, and clarity for minor errors.
  • Discard data points with entirely illogical response outputs or reasoning, as these are unusable for AI training.
  • Proactively communicate challenges, queries, or concerns with Project Managers to ensure smooth operations.
  • Meet key deadlines while maintaining quality and consistency in work output.
  • Qualifications

  • Malaysian citizen fluent in English and Bahasa Melayu (reading and writing).
  • Able to evaluate logic, language clarity, and reasoning structure.
  • Capable of detecting unnatural language caused by machine translation and adapt it while maintaining meaning.
  • Attention to detail and a high level of accuracy in detecting errors in spelling, grammar, and conversation flow.
  • Efficient time management skills to meet and exceed daily deliverables.
  • Professional attitude : responsive and inquisitive to ask clarifying questions.
  • Possess a laptop or desktop computer with a stable internet connection.
  • High attention to detail and ability to follow strict linguistic and structural guidelines.
  • Comfortable working with LLM-generated content and chat-style datasets.
  • Bonus : prior experience in LLM evaluation or validation and data annotation projects, especially in linguistics.
  • Work Arrangements

  • Available for at least 5-8 hours per day, including on weekends when necessary. Flexible core work hours from 9 : 00 am - 6 : 00 pm.
  • Able to commit to the project from November 19th to November 30th, 2025.
  • 100% remote work opportunity.
  • Work from the comfort of your own home.
  • Be part of a forward-thinking AI enablement company in Malaysia.
  • Gain invaluable work experience on an AI solution that represents Malaysian languages and dialects.
  • Accelerate AI development with Chemin by training next-generation language models!

    #J-18808-Ljbffr

    Buat amaran kerja untuk carian ini

    Data • Ipoh, Perak, Malaysia

    Pekerjaan berkaitan
    • Dinaikkan pangkat
    Bilingual Content Editor

    Bilingual Content Editor

    DataAnnotationIpoh, Perak, Malaysia
    We are looking for a bilingual Content Editor to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu
    • Dinaikkan pangkat
    Professional, Transactions Management (Mandarin Speaking)

    Professional, Transactions Management (Mandarin Speaking)

    Jones Lang LaSalle IncorporatedIpoh, Perak, Malaysia
    Professional, Transactions Management (Mandarin Speaking) page is loaded## Professional, Transactions Management (Mandarin Speaking)remote type : Remotelocations : Kuala Lumpur, Malaysiatime type...Tunjukkan lagiKemas kini terakhir: 13 hari yang lalu
    • Dinaikkan pangkat
    • Baharu!
    Quantity Surveyor

    Quantity Surveyor

    Henree Chuah Engineering Sdn BhdTaiping, Perak, Malaysia
    Location : Henree Chuah Engineering Sdn.Working Time : Mon-Fri : 8am~5pm .Assist to complete tender tasks which includes : . Preparing tender documents, including bills of quantities, unit rates, tec...Tunjukkan lagiKemas kini terakhir: 12 jam yang lalu
    • Dinaikkan pangkat
    • Baharu!
    Freelance Luxury Brand Evaluator in Pahang, Malaysia

    Freelance Luxury Brand Evaluator in Pahang, Malaysia

    CXG groupIpoh, Perak, Malaysia
    Turn your passion for luxury into a career opportunity! Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles. Join CXG, the global leader in cust...Tunjukkan lagiKemas kini terakhir: 10 jam yang lalu
    • Dinaikkan pangkat
    Voice Talent Required - Malay

    Voice Talent Required - Malay

    LILT AIIpoh, Perak, Malaysia
    Join to apply for the Voice Talent Required - Malay role at LILT AI.AI is changing how the world communicates — and LILT is leading that transformation. We're on a mission to make the world's inform...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu
    • Dinaikkan pangkat
    • Baharu!
    Site Leader – Malaysia Datacenter

    Site Leader – Malaysia Datacenter

    Coherent Corp.Ipoh, Perak, Malaysia
    Site Leader – Malaysia Datacenter.Primary Duties & Responsibilities.Prepare site annual plan and budget with BU input.Manage site operations and assure compliance activities.Engage with BU on SIOP ...Tunjukkan lagiKemas kini terakhir: 10 jam yang lalu
    • Dinaikkan pangkat
    AI Data Specialist - Chinese

    AI Data Specialist - Chinese

    RWS GroupIpoh, Perak, Malaysia
    AI Data Specialist - Chinese (Remote).We are looking for an AI Data Specialist to support the improvement of AI-generated content in English. This is a freelance, part‑time role based remotely with ...Tunjukkan lagiKemas kini terakhir: 18 hari yang lalu
    • Dinaikkan pangkat
    • Baharu!
    Senior Business Analyst - Insurance, Cantonese Speaker (Fully Remote)

    Senior Business Analyst - Insurance, Cantonese Speaker (Fully Remote)

    CoverGo LimitedIpoh, Perak, Malaysia
    Working on the latest tech for the Insurtech Market Leader.At CoverGo, our mission is to empower all insurance companies to make insurance 100% digital and accessible to everyone.We are a leading g...Tunjukkan lagiKemas kini terakhir: 10 jam yang lalu
    • Dinaikkan pangkat
    • Baharu!
    Talent Acquisition Partner - KL, Malaysia

    Talent Acquisition Partner - KL, Malaysia

    CygnifyIpoh, Perak, Malaysia
    Talent Acquisition Partner - KL, Malaysia.Cygnify is a dynamic and innovative talent solutions provider specializing in Talent Acquisition as a Service (TAaaS) for technology start-ups across the r...Tunjukkan lagiKemas kini terakhir: 12 jam yang lalu
    • Dinaikkan pangkat
    Software Test Engineer (Kuala Lumpur, Malaysia)

    Software Test Engineer (Kuala Lumpur, Malaysia)

    WeshineIpoh, Perak, Malaysia
    Weshine is hiring for our client (ESGpedia Singapore Pte Ltd), based in Singapore, for a digital remote role.ESGpedia Singapore Pte Ltd is Asia's leading ESG FinTech, underpinning the Monetary Auth...Tunjukkan lagiKemas kini terakhir: 5 hari yang lalu