Responsibilities
Build, test, and maintain ingestion and transformation pipelines in Databricks.
Implement business logic and transformations using DBT or Coalesce.
Handle data wrangling, cleansing, and CDC-based incremental loads.
Ensure scalability, maintainability, and quality of pipelines.
Conduct unit and integration testing for transformations.
Collaborate with BI and data governance teams to ensure consistent data structures.
Implement the architectural designs and ensure data accuracy.
Required Skills & Experience
5-7 years in data processing, cloud computing, data platform and other big data technologies - preferably in mining or heavy industries.
Strong expertise and experience in Azure Databricks and other ETL / ELT tools, SQL, CI / CD and data quality frameworks.
Experience or exposure to transformation tool like DBT or Coalesce or Azure Data Factory or Boomi Integration Platform is an advantage, but not mandatory.
Excellent technical design and build documentation.
Strong team player.
#J-18808-Ljbffr
Data Engineer • SelangorMalaysia, Selangor, Malaysia