Talent.com
Databricks Machine Learning Lead

Databricks Machine Learning Lead

AVANADE ASIA PTE LTDKuala Lumpur, Kuala Lumpur, Malaysia
17 hari lalu
Penerangan pekerjaan

Databricks M / L Technical Lead

The Databricks M / L Technical Lead is a senior, hands‑on role responsible for the design, development, and delivery of highly scalable, secure, and performant data solutions on the Databricks Lakehouse Platform . It is expected to provide technical leadership to a team of engineers, defining coding standards, implementing architectural patterns, and ensuring the delivery of high‑quality data products.

Key Responsibilities

  • Lead the Design : Define and implement robust data architectures utilizing the Databricks ecosystem, including Delta Lake, Unity Catalog, Machine Learning Models and Databricks Workflows .
  • Hands‑on Development : Serve as the most senior developer, writing high‑quality, production‑grade code in PySpark / Scala and SQL for complex batch and streaming ETL / ELT pipelines.
  • Performance Optimization : Lead performance tuning and optimization efforts for large‑scale Spark jobs, ensuring efficient cluster utilization and cost management.
  • Standards & Best Practices : Define and enforce technical standards, code quality, testing frameworks (unit, integration), and DataOps / CI / CD pipelines for the engineering team.

Qualifications

  • Required Skills & Experience :
  • 8+ years of experience in machine learning, data science, or MLOps, with at least 4+ years focused specifically on the Databricks Lakehouse Platform .
  • Expert proficiency in Python and PySpark / Scala for large‑scale data processing and machine learning.
  • Deep understanding and practical experience with Delta Lake architecture and optimization techniques.
  • Proven expertise implementing MLOps principles using MLflow (Tracking, Registry, Projects, and Deployment).
  • Preferred Skills & Certifications :
  • Experience with Databricks features like Databricks Workflows and Unity Catalog .
  • Experience with streaming technologies (e.g., Kafka, Spark Streaming).
  • Familiarity with CI / CD tools and Infrastructure-as-Code (e.g., Terraform, Databricks Asset Bundles).
  • Databricks Certified Machine Learning Professional certification.

    • Application Questions

  • Which of the following statements best describes your right to work in Malaysia?
  • How many years' experience do you have as a Machine Learning Lead?

    • #J-18808-Ljbffr

    Buat amaran kerja untuk carian ini

    Machine Learning • Kuala Lumpur, Kuala Lumpur, Malaysia