Talent.com
This job offer is not available in your country.
AI Infrastructure Engineer

AI Infrastructure Engineer

YTL AI LabsKuala Lumpur, Kuala Lumpur, Malaysia
8 hours ago
Job description

Join to apply for the AI Infrastructure Engineer role at YTL AI Labs

At YTL AI Labs, we build sovereign AI models that perform on par with the world’s best—while staying grounded in local needs, values, and context. Our flagship model, Ilmu, is designed to be culturally aware, contextually intelligent, and fluent in Bahasa Melayu, delivering cutting-edge solutions that empower Malaysian businesses with intelligence that truly understands the market and the people they serve.

As pioneers of sovereign AI, we believe every nation should have the power to shape its own intelligence—guided by its people, priorities, and principles.

About the Role

As an AI Infrastructure Engineer , you’ll build and maintain the systems that power our AI applications and model training. Your work will ensure our teams can run AI workloads reliably, securely, and at scale — across both cloud and on-prem environments.

This role combines DevOps, ML systems, and infrastructure engineering to support everything from LLMs to training pipelines.

What you’ll do

  • Build and maintain infrastructure for model hosting, prompt execution, and training workflows
  • Operate and optimize model-serving systems like vLLM, Triton, or OpenAI proxies
  • Implement secure API gateways and manage token usage, routing, and fallback
  • Develop and support training pipelines, GPU scheduling, and experiment tracking
  • Maintain CI / CD systems, observability tools, and infrastructure documentation

What We’re Looking For

  • 6+ years' experience in infrastructure engineering, DevOps, or ML systems
  • Strong command of Kubernetes, Terraform, and cloud-native architecture (AWS, Azure, GCP)
  • Experience with containerization, CI / CD, and API security practices
  • Prior exposure to model hosting or ML pipeline orchestration
  • Understanding of networking concepts including VPNs, VNets, and hybrid connectivity
  • Familiarity with security best practices for cross-platform infrastructure
  • Experience with on-prem infrastructure including networking, storage hardware
  • Bonus points if you have

  • Experience with GPU resource orchestration or Kubeflow
  • Familiarity with inference servers like vLLM, Triton, TGI, or TorchServe
  • Understanding of cost telemetry and resource budgeting for model traffic
  • Security mindset and experience with IAM, logging, and compliance
  • Familiarity with compliance frameworks (SOC2, GDPR, HIPAA) and implementing controls
  • Background in database management across different platforms
  • If you’re looking to do meaningful work with people who care about how we get there — we’d love to meet you. Apply now!

    #J-18808-Ljbffr

    Create a job alert for this search

    Infrastructure Engineer • Kuala Lumpur, Kuala Lumpur, Malaysia

    Related jobs
    • Promoted
    • New!
    Applied AI Engineer

    Applied AI Engineer

    DerivCyberjaya, Selangor, Malaysia
    Deriv is an AI-first company transforming trading through cutting-edge technology.You will design, develop, and deploy AI-driven solutions that power internal tools, marketing automation, and secur...Show moreLast updated: 2 hours ago
    • Promoted
    • New!
    AI Engineer (FSI)

    AI Engineer (FSI)

    Neurons LabKuala Lumpur, Kuala Lumpur, Malaysia
    Neurons Lab Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia.AI Engineer (BFSI) – Kuala Lumpur.We\'re building AI solutions for major banks, insurance companies, and asset management firms...Show moreLast updated: 2 hours ago
    • Promoted
    • New!
    IT Infrastructure Architect

    IT Infrastructure Architect

    BITZARO INNOVATIVE SDN BHDKuala Lumpur, Kuala Lumpur, Malaysia
    Drive the definition of infrastructure architecture and roadmap including : .Architecture vision, principles, standards (including standard products and platforms) and policies.Target state blueprint...Show moreLast updated: 2 hours ago
    • Promoted
    • New!
    Cloud Engineer

    Cloud Engineer

    HytechKuala Lumpur, Kuala Lumpur, Malaysia
    Hytech Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia.Hytech Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia. We specialize in providing digital transformation for fintech and f...Show moreLast updated: 2 hours ago
    • Promoted
    Solutions Architect (Insurance) - Fully Remote

    Solutions Architect (Insurance) - Fully Remote

    CoverGo | InsurtechKepong, Kuala Lumpur, Malaysia
    Working on the latest tech for the Insurtech Market Leader.At CoverGo, our mission is to empower all insurance companies to make insurance 100% digital and accessible to everyone.We are a leading g...Show moreLast updated: 17 days ago
    • Promoted
    • New!
    Engineer, Cloud Infrastructure (AWS / Azure)

    Engineer, Cloud Infrastructure (AWS / Azure)

    SingtelKuala Lumpur, Kuala Lumpur, Malaysia
    Singtel Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia.We are seeking a Cloud Infrastructure Engineer to enhance operational efficiency and scalability through automation and Infrastruct...Show moreLast updated: 2 hours ago
    • Promoted
    Cloud Engineer

    Cloud Engineer

    XtremaxKuala Lumpur, Kuala Lumpur, Malaysia
    Xtremax Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia.Xtremax Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia. Be among the first 25 applicants.Get AI-powered advice on this jo...Show moreLast updated: 30+ days ago
    Senior / Network Engineers (Multiple roles available) - AI Fintech

    Senior / Network Engineers (Multiple roles available) - AI Fintech

    CygnifyKuala Lumpur, 14, my
    Quick Apply
    Role : Senior / Network Engineers (Multiple roles available) - AI Fintech.We are partnering with an AI Fintech who looking for Senior / Network Engineers to join their growing team in Kuala Lumpur, ...Show moreLast updated: 5 days ago
    • Promoted
    Technical Marketing Engineer

    Technical Marketing Engineer

    Infotree Global SolutionsKuala Selangor, Kuala Selangor, Malaysia
    Job title : Developer : Technical Marketing - III.Max salary budget : RM8,000 / month.Experience : 5+ years in technical roles, 2+ years with developers, coding skills, and hands-on AI / edge / IoT experienc...Show moreLast updated: 15 days ago
    • Promoted
    AI Engineer (Python, Gen AI)

    AI Engineer (Python, Gen AI)

    DHLCyberjaya, Selangor, Malaysia
    With a global team of 5600+ IT professionals, DHL IT Services.Our offices in Cyberjaya, Prague, and Chennai have earned.At IT Services, we are passionate about technology.Our team is continuously e...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Freelance Developer Consultant (Kotlin) - AI Trainer

    Freelance Developer Consultant (Kotlin) - AI Trainer

    MindriftKlang Municipal Council, Klang Municipal Council, Malaysia
    Freelance Developer Consultant (Kotlin) - AI Trainer.This opportunity is a remote freelance role with Mindrift, focused on evolving GenAI models and contributing as an AI Tutor in Coding.Applicants...Show moreLast updated: 2 hours ago
    • Promoted
    • New!
    Freelance AI Solutions Engineer - Generative AI & Data Workflows

    Freelance AI Solutions Engineer - Generative AI & Data Workflows

    MindriftShah Alam, Shah Alam, Malaysia
    Freelance AI Solutions Engineer - Generative AI & Data Workflows.Be among the first 25 applicants.This opportunity is only for candidates currently residing in the specified country.Your location m...Show moreLast updated: 2 hours ago
    • Promoted
    • New!
    AI / ML Engineer

    AI / ML Engineer

    Russell TobinKuala Lumpur, Kuala Lumpur, Malaysia
    Senior Associate - Talent Acquisition - Corporate Strategy Hiring | Specialized in APAC.Direct message the job poster from Russell Tobin. Responsible for designing and delivering hybrid AI Platform....Show moreLast updated: 2 hours ago
    • Promoted
    Unix AIX Engineer

    Unix AIX Engineer

    OCBCCyberjaya, Selangor, Malaysia
    Provide Level 3 support for IBM AIX operating systems and related technologies.Troubleshoot and resolve complex hardware and software issues on IBM AIX systems. Perform system administration tasks s...Show moreLast updated: 22 days ago
    • Promoted
    CLOUD & INFRASTRUCTURE ANALYST

    CLOUD & INFRASTRUCTURE ANALYST

    LogicalisCyberjaya, Selangor, Malaysia
    As a Cloud & Digital Workplace Analyst, you will provide first-line support for virtual servers and Microsoft Azure environments. You will perform daily operational tasks, monitor systems, handle ba...Show moreLast updated: 30+ days ago
    • Promoted
    Infrastructure Engineer

    Infrastructure Engineer

    Dassault SystèmesPetaling Jaya, Selangor, Malaysia
    Malaysia! Unlock your potential with Dassault Systèmes, a global leader in Scientific Software Engineering as an Infrastructure Engineer in Malaysia!. Design, deploy, monitor, & maintain IT infrastr...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    IT Infrastructure Engineer

    IT Infrastructure Engineer

    Konica Minolta MalaysiaPetaling Jaya, Selangor, Malaysia
    The Infrastructure Engineer will support hybrid infrastructure environments, including on-premises and Microsoft Azure cloud services. This role focuses on coordinating infrastructure-related projec...Show moreLast updated: 2 hours ago
    • Promoted
    AI Solutions Engineer

    AI Solutions Engineer

    Academy of Artificial IntelligencePuchong, Selangor, Malaysia
    At Academy of AI, we’re on a mission to make AI practical, intuitive, and accessible.Partner with designers to turn user needs into clear flows, prototypes, and delightful AI experiences.Test, iter...Show moreLast updated: 8 days ago