Databricks Machine Learning Lead

Databricks M / L Technical Lead

The Databricks M / L Technical Lead is a senior, hands‑on role responsible for the design, development, and delivery of highly scalable, secure, and performant data solutions on the Databricks Lakehouse Platform . It is expected to provide technical leadership to a team of engineers, defining coding standards, implementing architectural patterns, and ensuring the delivery of high‑quality data products.

Key Responsibilities

• Lead the Design : Define and implement robust data architectures utilizing the Databricks ecosystem, including Delta Lake, Unity Catalog, Machine Learning Models and Databricks Workflows .
• Hands‑on Development : Serve as the most senior developer, writing high‑quality, production‑grade code in PySpark / Scala and SQL for complex batch and streaming ETL / ELT pipelines.
• Performance Optimization : Lead performance tuning and optimization efforts for large‑scale Spark jobs, ensuring efficient cluster utilization and cost management.
• Standards & Best Practices : Define and enforce technical standards, code quality, testing frameworks (unit, integration), and DataOps / CI / CD pipelines for the engineering team.

Qualifications

Application Questions

#J-18808-Ljbffr