AI Infrastructure Engineer (Senior / Team Lead)
Neuron Solutions Sdn BhdKuala Lumpur, Kuala Lumpur, Malaysia2 hari lalu
Penerangan pekerjaanOperate and optimize model‑serving infrastructure (e.g., vLLM, Triton, OpenAI proxies). Build and maintain tool execution runtimes and internal service orchestration layers. Implement secure API gateways, rate limiting, authentication, and quota management. Training Infrastructure Manage GPU scheduling, storage access, and experiment tracking (e.g., MLflow, Weights & Biases). Partner with AI researchers and platform engineers to operationalise training and evaluation runs. Maintain dataset versioning, access control, and data preprocessing pipelines. Platform Operations Establish observability and monitoring systems across model, memory, and agent services. Apply best practices for infrastructure security, availability, and cost optimization. Document infrastructure components and standard deployment practices. 6+ years' experience in infrastructure engineering, DevOps, or ML systems Strong command of Kubernetes, Terraform, and cloud-native architecture (AWS, Azure, GCP) Experience with containerization, CI / CD, and API security practices Prior exposure to model hosting or ML pipeline orchestration Understanding of networking concepts including VPNs, VNets, and hybrid connectivity. Familiarity with security best practices for cross‑platform infrastructure. Experience with on‑prem infrastructure including networking, storage hardware Experience with GPU resource orchestration or Kubeflow Familiarity with inference servers like vLLM, Triton, TGI, or TorchServe Understanding of cost telemetry and resource budgeting for model traffic Security mindset and experience with IAM, logging, and compliance Familiarity with compliance frameworks (SOC2, GDPR, HIPAA) and implementing controls. Background in database management across different platforms. Application infra consistently meets SLAs for latency, availability, and model cost‑efficiency Model gateway and tool runtimes are secure, observable, and used across all verticals without incident Training infra enables researchers or platform engineers to run fine‑tuning and evaluation jobs with minimal bottlenecks CI / CD, monitoring, and deployment standards are adopted org-wide for AI workloads You proactively identify and resolve scaling, quota, or security risks before they impact productions
As an Infrastructure Platform Engineer, you will build and maintain the infrastructure that powers both our AI application runtime and model training workflows. You will own secure, observable, and scalable environments that support model hosting, prompt execution, agent tools, and internal model training pipelines. Your work ensures that product and platform engineers can deploy and scale AI workloads efficiently across cloud and on‑prem infrastructure. This role blends DevOps, ML systems engineering, and platform development for AI workloads.
Responsibilities
- Application Infrastructure
Manage model routing, fallback, and token usage enforcement across LLM providers.
Develop training pipelines for pre‑training and other fine‑tuning workflows.
Maintain CI / CD systems for platform services and runtime components.
Qualifications
Must-Have
Bonus
What Success Looks Like
Senior Level
Mid‑Senior level
Employment Type
Full-time
Job Function
Information Technology
Referrals increase your chances of interviewing at Neuron Solutions Sdn Bhd by 2x
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia
Salary : MYR7,000 - MYR10,000
#J-18808-Ljbffr
Buat amaran kerja untuk carian ini
Infrastructure Engineer • Kuala Lumpur, Kuala Lumpur, Malaysia
Pekerjaan yang berkaitan
Regulated and trusted by financial institutions globally.Pioneers in mobile point-of-sale (mPOS) solutions focusing on low-cost acceptance payment.
Secured US$30M Series B funding.Rapid growth : scal...Tunjukkan lagiKemas kini terakhir: 12 hari yang lalu
![Senior Cloud Infrastructure Engineer [AWS]](https://cdn-logos.talent.com/v1/logo/image?feedcode=whatjobs-my&company_name=Shiji%20Group)
- Dinaikkan pangkat
Senior Infrastructure Engineer
Larian StudiosKuala Lumpur, Kuala Lumpur, Malaysia With multiple awards to our name, Larian Studios has proven that we’re dedicated to delivering high-quality role-playing games.
As we move on to new projects, the studio that brought you Baldur’s Ga...Tunjukkan lagiKemas kini terakhir: 23 hari yang lalu
- Dinaikkan pangkat
- Baharu!
Senior Associate - Infrastructure Engineer
PwC MalaysiaKuala Lumpur, Kuala Lumpur, Malaysia PwC Malaysia Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia.Senior Associate - Infrastructure Engineer.At PwC, our people in data and analytics focus on leveraging data to drive insights...Tunjukkan lagiKemas kini terakhir: 21 jam yang lalu
- Dinaikkan pangkat
Azure AI Architect (APAC)
AvanadeKuala Lumpur, Kuala Lumpur, Malaysia Azure AI Architect (APAC) - Avanade.Avanade Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia.Our talented Data & AI Practice is made up of globally recognized experts — and there’s room fo...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu
Lead / Senior Data Engineer
Capcon AsiaKuala Lumpur, MalaysiaQuick Apply
- Dinaikkan pangkat
Senior Infrastructure Engineer
DHL GermanyCyberjaya, Selangor, Malaysia Senior Infrastructure Engineer (Splunk).With a global team of 5600+ IT professionals, DHL IT Services connects people and keeps the global economy running by continuously innovating and creating su...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu
- Dinaikkan pangkat
Senior Infrastructure Engineer (Splunk)
DHL GermanyPetaling Jaya, Selangor, Malaysia Senior Infrastructure Engineer (Splunk).With a global team of 6000+ IT professionals, DHL IT Services.Our offices in Cyberjaya, Prague, and Chennai have earned.
At IT Services, we are passionate abo...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu
- Dinaikkan pangkat
Senior Cloud Infrastructure Engineer
Averis Sdn BhdKuala Lumpur, Kuala Lumpur, Malaysia Senior Cloud Infrastructure Engineer.Head of Cloud Platform, and work on setting up and maintaining a robust and highly automated cloud infrastructure.
You will be part of the team in building from ...Tunjukkan lagiKemas kini terakhir: 20 hari yang lalu
- Dinaikkan pangkat
Cloud Engineer (Gen AI)
MaybankKuala Lumpur, Kuala Lumpur, Malaysia Design, implement, and manage cloud-based infrastructures to support scalable and secure applications, with a focus on deployments involving AI technologies.
Develop and maintain scalable, secure cl...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu
- Dinaikkan pangkat
Relocate to Malta Azure Cloud Technical Architect Infrastructure (Big 4)
Black Pen RecruitmentKuala Lumpur, Kuala Lumpur, Malaysia The Azure Technical Architect is responsible for delivering and implementing Azure solutions for clients.The Technical Architect will design Azure solutions on IaaS and PaaS and will be comfortable...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu
- Dinaikkan pangkat
Senior Infrastructure Engineer (Splunk)
DHLCyberjaya, Selangor, Malaysia Senior Infrastructure Engineer (Splunk).With a global team of 6000+ IT professionals, DHL IT Services connects people and keeps the global economy running by continuously innovating and creating su...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu
- Dinaikkan pangkat
Senior IT Infrastructure Engineer | MNC Tech Group | Petaling Jaya
Career HorizonsPetaling Jaya, Selangor, Malaysia Join a leading MNC Tech services Group in their team based in Petaling Jaya.Great learning opportunity and career progression lies ahead with their fast-growing team undergoing business diversifica...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu
- Dinaikkan pangkat
- Baharu!
Lead AI Engineer
Boost BankKuala Lumpur, Kuala Lumpur, Malaysia Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia.The Lead, AI Engineer is a senior role responsible for designing, building, and deploying next-generation AI systems that enable Boost Bank...Tunjukkan lagiKemas kini terakhir: 21 jam yang lalu
- Dinaikkan pangkat
Infrastructure Engineer
Larian StudiosKuala Lumpur, Kuala Lumpur, Malaysia With multiple awards to our name, Larian Studios has proven that we’re dedicated to delivering high-quality role-playing games.
As we move on to new projects, the studio that brought you Baldur’s Ga...Tunjukkan lagiKemas kini terakhir: 20 hari yang lalu
- Dinaikkan pangkat
IT Infrastructure Team Lead
BusinesslistKuala Lumpur, Kuala Lumpur, Malaysia IT Infrastructure Team Lead Posting Date : 14 Aug 2025 | Close Date : 12 Nov 2025.To lead the Infrastructure team towards a highly integrated and reliable IT system for the organization and operate ...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu
- Dinaikkan pangkat
Senior Infrastructure Engineer
GrabPetaling Jaya, Selangor, Malaysia Grab is Southeast Asia's leading superapp.From getting your favourite meals delivered to helping you manage your finances and getting around town hassle-free, we've got your back with everything.In...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu
- Dinaikkan pangkat
Senior Cloud Infrastructure Engineer [AWS]
Shiji GroupKuala Lumpur, Kuala Lumpur, Malaysia Shiji Group provides software solutions and services for the hospitality, food service, retail, and entertainment industries, ranging from hotel management solutions to food and beverage and retail...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu
- Dinaikkan pangkat
Senior Infrastructure Engineer
GrabTaxi Holdings Pte. Ltd.Petaling Jaya, Selangor, Malaysia Grab is Southeast Asia's leading superapp.From getting your favourite meals delivered to helping you manage your finances and getting around town hassle-free, we've got your back with everything.In...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu
- Dinaikkan pangkat
Senior Infrastructure Engineer (OpenShift / Kubernetes)
DHLCyberjaya, Selangor, Malaysia Senior Infrastructure Engineer (OpenShift / Kubernetes).With a global team of 6000+ IT professionals, DHL IT Services.Our offices in Cyberjaya, Prague, and Chennai have earned.At IT Services, we are ...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu