Talent.com
Databricks Machine Learning Lead

Databricks Machine Learning Lead

AvanadeKuala Lumpur, Kuala Lumpur, Malaysia
4 hari lalu
Penerangan pekerjaan

Avanade Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia

Overview

Our talented Data & AI Practice is made up of globally recognized experts - and there’s room for more analytical and ambitious data professionals. If you’re passionate about helping clients make better data-driven decisions to tackle their most complex business issues, let’s talk. Take your skills to a new level and launch a career where you can truly do what matters.

Databricks M / L Technical Lead is a senior, hands-on role responsible for the design, development, and delivery of highly scalable, secure, and performant data solutions on the Databricks Lakehouse Platform . It is expected to provide technical leadership to a team of engineers, defining coding standards, implementing architectural patterns, and ensuring the delivery of high-quality data products.

What you’ll do

  • Lead the Design : Define and implement robust data architectures utilizing the Databricks ecosystem, including Delta Lake, Unity Catalog, Machine Learning Models and Databricks Workflows.
  • Hands-on Development : Serve as the most senior developer, writing high-quality, production-grade code in PySpark / Scala and SQL for complex batch and streaming ETL / ELT pipelines.
  • Performance Optimization : Lead performance tuning and optimization efforts for large-scale Spark jobs, ensuring efficient cluster utilization and cost management.
  • Standards & Best Practices : Define and enforce technical standards, code quality, testing frameworks (unit, integration), and DataOps / CI / CD pipelines for the engineering team.

Skills & Experience

Required Skills & Experience

  • 8+ years of experience in machine learning, data science, or MLOps, with at least 4+ years focused specifically on the Databricks Lakehouse Platform.
  • Expert proficiency in Python and PySpark / Scala for large-scale data processing and machine learning.
  • Deep understanding and practical experience with Delta Lake architecture and optimization techniques.
  • Proven expertise implementing MLOps principles using MLflow (Tracking, Registry, Projects, and Deployment).

    • Preferred Skills & Certifications

  • Experience with Databricks features like Databricks Workflows, and Unity Catalog.
  • Experience with streaming technologies (e.g., Kafka, Spark Streaming).
  • Familiarity with CI / CD tools and Infrastructure-as-Code (e.g., Terraform, Databricks Asset Bundles).
  • Databricks Certified Machine Learning Professional certified.

    • About You

  • Consultative, collaborative, curious
  • Resilient, adaptable, flexible
  • Humble leader, strong negotiator, relationship builder
  • Passionate about tech and engaging with and advising clients

    • What You’ll Do / Learn more

    To learn more about the types of projects our Data & AI team works on check out these case studies :

  • thyssenkrupp Materials Services uses data to help strike a delicate operational balance
  • What matters to SSE Renewables is innovating for a sustainable future
  • Hachette UK enables employees with machine learning-driven contract searches
  • Marston Holdings identifies significant cloud savings

    • Interested in knowing what’s going on inside Avanade? Check out our blogs :

  • Avanade Insights – exchange ideas that drive tomorrow’s innovation
  • Inside Avanade – explore what life is like working at Avanade

    • Benefits & Culture

    Some of the best things about working at Avanade include access to Microsoft’s Global Alliance Partner ecosystem, ongoing training and certifications, global technical resources, and a supportive, collaborative environment. Avanade is committed to an inclusive, diverse culture with a deep sense of belonging for all employees.

    Additional information about Belonging and Inclusion can be found on our Inclusion & Diversity page.

    Note : This description reflects the responsibilities and requirements of the role as posted and may be subject to change.

    #J-18808-Ljbffr

    Buat amaran kerja untuk carian ini

    Databricks Machine Learning Lead • Kuala Lumpur, Kuala Lumpur, Malaysia