Talent.com
Multilingual LLM Data Evaluator (Bahasa Melayu and English)

Multilingual LLM Data Evaluator (Bahasa Melayu and English)

CheminBatu Pahat, Johor, Malaysia
3 hari lalu
Penerangan pekerjaan

Chemin is partnering with a well-established enterprise with an innovation arm focused on emerging technologies, infrastructure, and AI-related initiatives. For this project, we are seeking individuals as LLM Evaluators who can read and write Bahasa Malaysia (BM) and English fluently.

You will evaluate AI-generated outputs by reviewing the response accuracy and reasoning or logic, using the chat history strictly as context. This role requires strong language skills, judgment, attention to detail, and the ability to identify logical, grammatical, and structural issues without altering the original meaning of outputs widely.

The key to your success is to ensure a high standard of excellence in performing validations, as quality is critical to enhancing AI models. Ultimately, alongside the Delivery Team at Chemin, you will shape how Malaysian languages are represented in the next generation of powerful large language models by refining a high volume and quality dataset.

  • Deliver precise validations of response outputs with minimal to no revisions.
  • Evaluate LLM prompts :

Ensure the response is accurate and aligned with the conversational context.

  • Verify that the reasoning supports the response logic.
  • Rewrite responses or reasoning where required, depending on the severity of issues.
  • Adapt text to sound natural in the service languages (Bahasa Malaysia and English), especially in cases where LLM outputs are affected by translation-related grammar errors.
  • Maintain the original meaning of the response output while improving sentence structure, grammar, and clarity for minor errors.
  • Discard data points with entirely illogical response outputs or reasoning, as these are unusable for AI training.
  • Proactively communicate challenges, queries, or concerns with Project Managers to ensure smooth operations.
  • Meet key deadlines while maintaining quality and consistency in work output.
  • Qualifications

  • Malaysian citizen fluent in English and Bahasa Melayu (reading and writing).
  • Able to evaluate logic, language clarity, and reasoning structure.
  • Capable of detecting unnatural language caused by machine translation and adapt it while maintaining meaning.
  • Attention to detail and a high level of accuracy in detecting errors in spelling, grammar, and conversation flow.
  • Efficient time management skills to meet and exceed daily deliverables.
  • Professional attitude : responsive and inquisitive to ask clarifying questions.
  • Possess a laptop or desktop computer with a stable internet connection.
  • High attention to detail and ability to follow strict linguistic and structural guidelines.
  • Comfortable working with LLM-generated content and chat-style datasets.
  • Bonus : prior experience in LLM evaluation or validation and data annotation projects, especially in linguistics.
  • Work Arrangements

  • Available for at least 5-8 hours per day, including on weekends when necessary. Flexible core work hours from 9 : 00 am - 6 : 00 pm.
  • Able to commit to the project from November 19th to November 30th, 2025.
  • 100% remote work opportunity.
  • Work from the comfort of your own home.
  • Be part of a forward-thinking AI enablement company in Malaysia.
  • Gain invaluable work experience on an AI solution that represents Malaysian languages and dialects.
  • Accelerate AI development with Chemin by training next-generation language models!

    #J-18808-Ljbffr

    Buat amaran kerja untuk carian ini

    Data • Batu Pahat, Johor, Malaysia

    Pekerjaan berkaitan
    • Dinaikkan pangkat
    • Baharu!
    Lead Counsel

    Lead Counsel

    respond.ioBatu Pahat, Johor, Malaysia
    Experience : 5 to 8 years in commercial or technology law.You will create the legal foundation that supports our next phase of scale and work directly with the executive team across commercial, priv...Tunjukkan lagiKemas kini terakhir: 20 jam yang lalu
    • Dinaikkan pangkat
    Freelance Luxury Brand Evaluator in Pahang, Malaysia

    Freelance Luxury Brand Evaluator in Pahang, Malaysia

    CXG groupBatu Pahat, Johor, Malaysia
    Turn your passion for luxury into a career opportunity! Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles. Join CXG, the global leader in cust...Tunjukkan lagiKemas kini terakhir: 3 hari yang lalu
    • Dinaikkan pangkat
    Experienced Malay Interpreter

    Experienced Malay Interpreter

    AsiaLocalizeBatu Pahat, Johor, Malaysia
    About the job Experienced Malay Interpreter.AsiaLocalize provides comprehensive translation and localization services to support clients in accessing and succeeding in global markets.With a wide ra...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu
    • Dinaikkan pangkat
    Remote Clinical Specialist - Rater Calibration (Malay)

    Remote Clinical Specialist - Rater Calibration (Malay)

    5PY IQVIA RDS Inc.Batu Pahat, Johor, Malaysia
    A global provider of clinical research services is seeking a Clinical Specialist Consultant to support clinical trials.This role requires fluency in Malay and experience in administering psychiatri...Tunjukkan lagiKemas kini terakhir: 3 hari yang lalu
    • Dinaikkan pangkat
    Remote Bilingual Interpreter - Healthcare & Public Services

    Remote Bilingual Interpreter - Healthcare & Public Services

    TeleperformanceBatu Pahat, Johor, Malaysia
    A leading language services provider in Malaysia is seeking a Language Interpreter to facilitate communication for individuals with language barriers. You will handle calls in a professional manner ...Tunjukkan lagiKemas kini terakhir: 2 hari yang lalu
    • Dinaikkan pangkat
    Strategic Health Systems Sales Leader; Malaysia Country Lead

    Strategic Health Systems Sales Leader; Malaysia Country Lead

    Philips InternationalBatu Pahat, Johor, Malaysia
    A global health technology leader is seeking a Health Systems Sales Leader and Country Manager for Malaysia.The candidate will be responsible for developing sales strategies, leading a team, and ma...Tunjukkan lagiKemas kini terakhir: 3 hari yang lalu
    • Dinaikkan pangkat
    Asia Regional Site Management Leader (Remote)

    Asia Regional Site Management Leader (Remote)

    GE VernovaMuar, Johor, Malaysia
    A leading energy company is seeking a Site Manager to oversee site management organization in Kuala Lumpur.The role includes ensuring successful execution of site projects, developing necessary pro...Tunjukkan lagiKemas kini terakhir: 1 hari yang lalu
    • Dinaikkan pangkat
    Bahasa Melayu and English Audio Transcriber (Part-Time)

    Bahasa Melayu and English Audio Transcriber (Part-Time)

    Chemin AIMuar, Johor, Malaysia
    Chemin has partnered with a leading company specializing in AI-driven language solutions, using advanced models to enable human‑like conversations and transform enterprise communication.For this ex...Tunjukkan lagiKemas kini terakhir: 8 hari yang lalu
    • Dinaikkan pangkat
    Lead Talent Acquisition : Build World-Class Teams (Remote)

    Lead Talent Acquisition : Build World-Class Teams (Remote)

    BjakMuar, Johor, Malaysia
    A financial services platform in Malaysia seeks a Lead, Talent Acquisition to drive recruitment efforts.This role involves managing the full-cycle hiring process and ensuring a positive candidate e...Tunjukkan lagiKemas kini terakhir: 1 hari yang lalu
    • Dinaikkan pangkat
    Talent Acquisition Partner - KL, Malaysia

    Talent Acquisition Partner - KL, Malaysia

    CygnifyBatu Pahat, Johor, Malaysia
    Talent Acquisition Partner - KL, Malaysia.Cygnify is a dynamic and innovative talent solutions provider specializing in Talent Acquisition as a Service (TAaaS) for technology start-ups across the r...Tunjukkan lagiKemas kini terakhir: 3 hari yang lalu
    • Dinaikkan pangkat
    Remote German O2C Analyst — Collections & Cash

    Remote German O2C Analyst — Collections & Cash

    Danaher CorporationMuar, Johor, Malaysia
    A global technology company in Kuala Lumpur is seeking an O2C Analyst with fluency in German to manage collection activities. The role involves supporting timely customer payments, stakeholder engag...Tunjukkan lagiKemas kini terakhir: 1 hari yang lalu
    • Dinaikkan pangkat
    Remote Yemeni Arabic AI Language Trainer

    Remote Yemeni Arabic AI Language Trainer

    Invisible Expert MarketplaceBatu Pahat, Johor, Malaysia
    An innovative AI training company seeks an Arabic (Yemeni) Language Expert to train AI models.This remote contract role requires expertise in phonetics, morphology, and syntax, alongside a Master’s...Tunjukkan lagiKemas kini terakhir: 3 hari yang lalu
    • Dinaikkan pangkat
    KL Hybrid Remote Recruiter Qualifier – User Studies

    KL Hybrid Remote Recruiter Qualifier – User Studies

    VoxelmapsMuar, Johor, Malaysia
    A recruiting firm in Kuala Lumpur is seeking a Recruiter Qualifier to assist with user study data collection.The role involves prescreening leads, scheduling appointments, and building relationship...Tunjukkan lagiKemas kini terakhir: 3 hari yang lalu
    • Dinaikkan pangkat
    • Baharu!
    Regional Engagement Lead — Global Cybersecurity (Remote)

    Regional Engagement Lead — Global Cybersecurity (Remote)

    PositkaBatu Pahat, Johor, Malaysia
    A boutique consulting firm is seeking a Regional Engagement Manager in Kuala Lumpur.This role requires 7+ years of experience in Project Management and fluency in Mandarin for client communication ...Tunjukkan lagiKemas kini terakhir: 20 jam yang lalu
    • Dinaikkan pangkat
    Remote L2 Tech Support Engineer – B2B / B2C

    Remote L2 Tech Support Engineer – B2B / B2C

    Dahua Technology Co. LTDBatu Pahat, Johor, Malaysia
    A leading technology company in Kuala Lumpur seeks a Global Technical Support Engineer for a 6-month contract.The role involves providing technical support to customers, coordinating with expert te...Tunjukkan lagiKemas kini terakhir: 3 hari yang lalu
    • Dinaikkan pangkat
    B2B Growth Lead — Remote, Flexible Hours

    B2B Growth Lead — Remote, Flexible Hours

    SlasifyMuar, Johor, Malaysia
    A rapidly growing technology company, Slasify, is seeking a highly skilled Business Development Manager to generate new business opportunities and maintain client relationships.This role offers the...Tunjukkan lagiKemas kini terakhir: 1 hari yang lalu
    • Dinaikkan pangkat
    Technical Solutions Architect II

    Technical Solutions Architect II

    Akamai Technologies GmbHBatu Pahat, Johor, Malaysia
    Join the Technical Solutions Architect team.Akamai is working to simplify the way people work in the cloud.The team's mission is to accelerate innovation by making computing simple, scalable, acces...Tunjukkan lagiKemas kini terakhir: 3 hari yang lalu
    • Dinaikkan pangkat
    Remote Multilingual Live-Chat Agent

    Remote Multilingual Live-Chat Agent

    AlphaiotabpoBatu Pahat, Johor, Malaysia
    A leading customer service provider in Kuala Lumpur is seeking a customer service representative to enhance customer satisfaction through live chats. Ideal candidates must have at least 1 year of ex...Tunjukkan lagiKemas kini terakhir: 3 hari yang lalu