Databricks Machine Learning Lead

Avanade Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia

Overview

Our talented Data & AI Practice is made up of globally recognized experts - and there’s room for more analytical and ambitious data professionals. If you’re passionate about helping clients make better data-driven decisions to tackle their most complex business issues, let’s talk. Take your skills to a new level and launch a career where you can truly do what matters.

Databricks M / L Technical Lead is a senior, hands-on role responsible for the design, development, and delivery of highly scalable, secure, and performant data solutions on the Databricks Lakehouse Platform . It is expected to provide technical leadership to a team of engineers, defining coding standards, implementing architectural patterns, and ensuring the delivery of high-quality data products.

What you’ll do

• Lead the Design : Define and implement robust data architectures utilizing the Databricks ecosystem, including Delta Lake, Unity Catalog, Machine Learning Models and Databricks Workflows.
• Hands-on Development : Serve as the most senior developer, writing high-quality, production-grade code in PySpark / Scala and SQL for complex batch and streaming ETL / ELT pipelines.
• Performance Optimization : Lead performance tuning and optimization efforts for large-scale Spark jobs, ensuring efficient cluster utilization and cost management.
• Standards & Best Practices : Define and enforce technical standards, code quality, testing frameworks (unit, integration), and DataOps / CI / CD pipelines for the engineering team.

Skills & Experience

Required Skills & Experience

Preferred Skills & Certifications

About You

What You’ll Do / Learn more

To learn more about the types of projects our Data & AI team works on check out these case studies :

Interested in knowing what’s going on inside Avanade? Check out our blogs :

Benefits & Culture

Some of the best things about working at Avanade include access to Microsoft’s Global Alliance Partner ecosystem, ongoing training and certifications, global technical resources, and a supportive, collaborative environment. Avanade is committed to an inclusive, diverse culture with a deep sense of belonging for all employees.

Additional information about Belonging and Inclusion can be found on our Inclusion & Diversity page.

Note : This description reflects the responsibilities and requirements of the role as posted and may be subject to change.

#J-18808-Ljbffr