Databricks Machine Learning Lead

Avanade Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia

Join to apply for the Databricks Machine Learning Lead role at Avanade

Our talented Data & AI Practice is made up of globally recognized experts - and there’s room for more analytical and ambitious data professionals. If you’re passionate about helping clients make better data-driven decisions to tackle their most complex business issues, let’s talk. Take your skills to a new level and launch a career where you can truly do what matters.

The Databricks M / L Technical Lead is a senior, hands‑on role responsible for the design, development, and delivery of highly scalable, secure, and performant data solutions on the Databricks Lakehouse Platform. It is expected to provide technical leadership to a team of engineers, defining coding standards, implementing architectural patterns, and ensuring the delivery of high-quality data products.

Key Responsibilities : Lead the Design : Define and implement robust data architectures utilizing the Databricks ecosystem, including Delta Lake, Unity Catalog, Machine Learning Models and Databricks Workflows. Hands‑on Development : Serve as the most senior developer, writing high‑quality, production‑grade code in PySpark / Scala and SQL for complex batch and streaming ETL / ELT pipelines. Performance Optimization : Lead performance tuning and optimization efforts for large‑scale Spark jobs, ensuring efficient cluster utilization and cost management. Standards & Best Practices : Define and enforce technical standards, code quality, testing frameworks (unit, integration), and DataOps / CI / CD pipelines for the engineering team.

Seniority level

• Mid‑Senior level

Employment type

Job function

Referrals increase your chances of interviewing at Avanade by 2x

#J-18808-Ljbffr