Talent.com
This job offer is not available in your country.
MCP & Tools Python Developer - Agent Evaluation Infrastructure

MCP & Tools Python Developer - Agent Evaluation Infrastructure

MindriftMY
8 hours ago
Job type
  • Quick Apply
Job description

This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English proficiency.

At Mindrift , innovation meets opportunity. We believe in using the power of collective human intelligence to ethically shape the future of AI.

The Mindrift platform, launched and powered by Toloka , connects domain experts with cutting-edge AI projects from innovative tech clients. Our mission is to unlock the potential of GenAI by tapping into real-world expertise from across the globe.

We’re on the hunt for hands-on Python engineers for a new project focused on developing Model Context Protocol (MCP) servers and internal tools for running and evaluating agent behavior. You’ll implement base methods for agent action verification, integrate with internal and client infrastructures, and help fill tooling gaps across the team.

Who we're looking for :

Calling all security researchers, engineers, and penetration testers with a strong foundation in problem-solving, offensive security, and AI-related risk assessment.

We’re looking for someone who can bring a hands-on approach to technical challenges, whether breaking into systems to expose weaknesses or building secure tools and processes. We value contributors with a passion for continuous learning, experimentation, and adaptability.

What you’ll be doing :

  • Developing and maintaining MCP-compatible evaluation servers
  • Implementing logic to check agent actions against scenario definitions
  • Creating or extending tools that writers and QAs use to test agents
  • Working closely with infrastructure engineers to ensure compatibility
  • Occasionally helping with test writing or debug sessions when needed

Although we’re only looking for experts for this current project, contributors with consistent high-quality submissions may receive an invitation for ongoing collaboration across future projects.

Requirements

  • 4+ years of Python development experience , ideally in backend or tools
  • Solid experience building APIs , testing frameworks, or protocol-based interfaces
  • Understanding of Docker, Linux CLI, and HTTP-based communication
  • Ability to integrate new tools into existing infrastructures
  • Familiarity with how LLM agents are prompted, executed, and evaluated
  • Clear documentation and communication skills - you’ll work with QA and writers
  • We also value applicants who have :

  • Experience with Model Context Protocol (MCP) or similar structured agent-server interfaces
  • Knowledge of FastAPI or similar async web frameworks
  • Experience working with LLM logs, scoring functions, or sandbox environments
  • Ability to support dev environments (devcontainers, CI configs, linters)
  • JS experience
  • Benefits

  • Get paid for your expertise, with  rates that can go up to $38 / hour  depending on your skills, experience, and project needs.
  • Take part in a flexible, remote, freelance project that fits around your primary professional or academic commitments.
  • Participate in an advanced AI project and gain valuable experience to enhance your portfolio.
  • Influence how future AI models understand and communicate in your field of expertise.
  • Create a job alert for this search

    Developer Python • MY

    Related jobs
    • Promoted
    Technical Support Engineer 1 (I5)

    Technical Support Engineer 1 (I5)

    Dell GmbHMalaysia, Malaysia
    At Dell Technologies, world-class service doesn’t end when a customer purchases our innovative products.Our Technical Support team is there for them whenever they need help – by phone or email, onl...Show moreLast updated: 4 days ago
    • Promoted
    Simplified Chinese to English Translator - Geoinformatics

    Simplified Chinese to English Translator - Geoinformatics

    Cactus CommunicationsMalaysia, Malaysia
    Simplified Chinese to English Translator - Geoinformatics.Editage, the flagship brand of.ESL (English-as-a-second-language) researchers communicate their science to the global scientific community....Show moreLast updated: 30+ days ago
    • Promoted
    Senior Network Engineer (Network Security)

    Senior Network Engineer (Network Security)

    DHL GermanyMalaysia, Malaysia
    Senior Network Engineer (Network Security).With a global team of 5600+ IT professionals, DHL IT Services.Our offices in Cyberjaya, Prague, and Chennai have earned. At IT Services, we are passionate ...Show moreLast updated: 16 days ago
    • Promoted
    AML Developer / Support

    AML Developer / Support

    ConfidentialMalaysia
    Junior AML Environment / Support Developer.Compliance Technology – AML / KYC.We are seeking a motivated and technically skilled. Junior AML Environment / Support Developer.The ideal candidate will have ...Show moreLast updated: 21 days ago
    • Promoted
    Analyst, EndPoint Mgmt- Malaysia-Pall India Pvt Ltd-1-3 - TimesJobs.com

    Analyst, EndPoint Mgmt- Malaysia-Pall India Pvt Ltd-1-3 - TimesJobs.com

    Pall India Pvt LtdMalaysia, Malaysia
    Are you ready to accelerate your potential and make a real difference within life sciences, diagnostics, and biotechnology?. You'll thrive in a culture of belonging where you and your unique viewpoi...Show moreLast updated: 2 days ago
    • Promoted
    Junior AML Environment / Support Developer

    Junior AML Environment / Support Developer

    ConfidentialMalaysia
    We're Hiring – Junior AML Environment / Support Developer (L2, 3–5 Years).Location : Malaysia (Onsite, Visa Sponsored).Infra / Environment setup, connectivity, patches & updates.WebLogic, Linux / Windows ...Show moreLast updated: 21 days ago
    Mid- Senior Full-Stack Developer

    Mid- Senior Full-Stack Developer

    SquadioMY
    Quick Apply
    We are seeking a skilled Full Stack Developer with expertise in Django and React to join our team.The ideal candidate will excel at designing, developing, and maintaining web applications using.Dja...Show moreLast updated: 18 days ago
    • Promoted
    AppSec Engineer – Vulnerability Triage Operations Center

    AppSec Engineer – Vulnerability Triage Operations Center

    ConfidentialMalaysia
    AppSec, or vulnerability operations team.Prior experience in working in a global / regional exposure is desirable, with prior experience in financial service and / or tech industry is a bonus.Experienc...Show moreLast updated: 21 days ago
    • Promoted
    Support Engineer, SAP PP / QM

    Support Engineer, SAP PP / QM

    Rimini StreetMalaysia, Malaysia
    Nasdaq : RMNI) is a global provider of end-to-end enterprise software support and innovation solutions, and the leading third-party support provider for Oracle, SAP and VMware software.The company o...Show moreLast updated: 30+ days ago
    • Promoted
    Associate DevOps Engineer (Java, Cloud)

    Associate DevOps Engineer (Java, Cloud)

    DHL GermanyMalaysia, Malaysia
    Associate DevOps Engineer (Java, Cloud).With a global team of 5600+ IT professionals, DHL IT Services.Our offices in Cyberjaya, Prague, and Chennai have earned. At IT Services, we are passionate abo...Show moreLast updated: 1 day ago
    • Promoted
    Application Engineer - (Klang Valley)

    Application Engineer - (Klang Valley)

    Monroe Consulting GroupMalaysia, Malaysia
    Application Engineer - Electric Automation.Executive recruitment company Monroe Consulting Group's.We are seeking an Application Engineer with a strong electric automation background who acts as a ...Show moreLast updated: 2 days ago
    • Promoted
    Associate Engineer-CMMS

    Associate Engineer-CMMS

    Oman ShellMalaysia, Malaysia
    Associate Engineer-CMMS page is loaded## Associate Engineer-CMMSlocations : Cyberjaya-Wisma Shellposted on : Posted 5 Days Agojob requisition id : R Selangor, Malaysia • •Job Family Group : • •Mainte...Show moreLast updated: 28 days ago
    • Promoted
    IIB Developer

    IIB Developer

    ConfidentialMalaysia
    IIB Developer / Senior IIB Developer.We are seeking an IIB Developer.The ideal candidate will have strong experience in IIB development and a solid understanding of integration patterns and technol...Show moreLast updated: 21 days ago
    • Promoted
    Cloud Deployment Engineer (CDE)

    Cloud Deployment Engineer (CDE)

    Monroe Consulting GroupMalaysia, Malaysia
    NOC Engineer - Linux & Application Support.Executive recruitment company Monroe Consulting Group's Technology Division is recruiting on behalf of a dynamic technology organization focused on high-p...Show moreLast updated: 2 days ago
    • Promoted
    • New!
    ASSISTANT RESIDENT ENGINEER

    ASSISTANT RESIDENT ENGINEER

    ZHL Engineers Sdn BhdPahangMalaysia, Pahang, Malaysia
    Add expected salary to your profile for insights.Ability to work independently with minimal supervision.Assist the Resident Engineer in site monitoring and inspections. Coordinate and oversee daily ...Show moreLast updated: 1 hour ago
    • Promoted
    Operation and Support Engineer (f / m / d)

    Operation and Support Engineer (f / m / d)

    ng-voiceMalaysia, Malaysia
    Operation and Support Engineer (f / m / d).Committed to building the next generation of 100% software-based mobile networks, combining DevOps with telecommunications expertise, ng-voice is creating inn...Show moreLast updated: 30+ days ago
    • Promoted
    Devops Engineer

    Devops Engineer

    ConfidentialMalaysia
    Minimum 8+ years of proven work experience in DevOps.Excellent coding and scripting skills and experience in implementing high-scale cloud architectures using modern, cloud-based container platform...Show moreLast updated: 21 days ago
    Evaluation Scenario Writer - QA

    Evaluation Scenario Writer - QA

    MindriftMY
    Quick Apply
    We believe in using the power of collective human intelligence to ethically shape the future of AI.The Mindrift platform, launched and powered by. AI projects from innovative tech clients.Our missio...Show moreLast updated: 11 days ago