Databricks Engineer

Job Title : Databricks (NOVARTIS)-112513-1

Contract Duration : Contract

Location : Kuala Lumpur, Malaysia (onsite)

Experience Level : 6 years

JD Below :

We're seeking a hands-on Senior Data Engineer to design, implement and operate scalable data pipelines on the Databricks Lakehouse Platform. You'll own ETL / ELT flows, Delta Live Tables, pipeline performance tuning, CI / CD for data engineering, and data governance - enabling BI and advanced analytics across the business.

Key responsibilities

• Design and implement scalable ETL / ELT pipelines using Apache Spark , Delta Lake , and Databricks Workflows (including Delta Live Tables).
• Build, maintain and operationalize Databricks-based data products to support BI, reporting and advanced analytics.
• Optimize Spark jobs and Delta queries with partitioning, predicate pushdown, join strategies, caching, and resource tuning.
• Implement CI / CD practices for notebooks and pipelines using Databricks Repos , Git , and Azure DevOps (or equivalent).
• Secure and govern data using Unity Catalog , role-based access control, and data masking techniques.
• Integrate Databricks with upstream / downstream systems (e.g., AWS S3 , Snowflake , Power BI ).
• Develop, publish, and maintain documentation and best practices (notebooks, runbooks, data lineage).
• Monitor pipeline health, implement alerting, and perform root-cause analysis for failures or performance regressions.
• Mentor junior engineers and promote re-usable, testable data engineering patterns.
• Work with product, analytics and platform teams to define SLAs, data contracts, and onboarding processes.

Required qualifications

Nice-to-have

About VDart

We are Purpose Driven, High Growth and a Great Place to Work Certified Organization!

VDart is one of the fastest growing talent management and digital solution providers established in the year 2007. As part of our continued Global Growth Strategy, we are excited to bring digital capabilities to Malaysia. VDart Malaysia Sdh Bhd will serve as our Regional Headquarters for ASEAN region. We are committed in bringing world class technology, build strong digital talent pool in emerging technologies and transform how businesses leverage technology in Malaysia. We serve various customers including Fortune 100 companies across various domains globally. VDart partners with industry leaders in Cloud, Intelligent Automation, IoT, Customer experience, and Security solutions. With distinct digital practices, we help our partners to build for tomorrow by reimaging their business today. From helping our partners to bridge talent in product development and embedded software, we provide resources and solutions globally across a wide range of industries, from automotive and mobility to energy, healthcare, and life sciences, manufacturing, consumer industries, and beyond.

VDart : Digital Consulting & Staffing Solutions

VDart is a leading digital consulting and staffing company founded in 2007 and headquartered in Alpharetta, Georgia. VDart is one of the top staffing companies in USA & also provides technology solutions, supporting businesses in their digital transformation journey. Digital consulting services, Digital consulting agency

Core Services :

Key Industries : VDart primarily serves industries such as automotive and mobility, banking and finance, healthcare and life sciences, and energy and utilities. VDart - Products, Competitors, Financials, Employees, Headquarters Locations

Notable Partnership : VDart Digital has been a consistently strong supplier for Toyota since 2017 Digital Transformation Consulting & Strategy Services | VDart Digital , demonstrating their capability in large-scale digital transformation projects.

With over 17 years of experience, VDart combines staffing expertise with technology solutions to help organizations modernize their operations and build skilled workforce capabilities across multiple sectors.