Data Engineer - Azure

AT Global Consulting Sdn BhdKuala Lumpur, Kuala Lumpur, Malaysia

9 jam yang lalu

Penerangan pekerjaan

We are seeking a skilled Data Engineer with strong expertise in Microsoft Azure’s data ecosystem to design, build, and optimize scalable data pipelines and platforms. The ideal candidate will have hands‑on experience with Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), and Databricks, with a focus on data security, performance optimization, and cloud‑based best practices.

Key Responsibilities

Design, develop, and maintain scalable data pipelines using Azure Data Factory (ADF) and Databricks.
Build and manage robust data storage solutions leveraging Azure Data Lake Storage.
Implement data ingestion, transformation, and integration workflows from multiple structured and unstructured data sources.
Ensure data security and compliance with enterprise and regulatory standards through proper encryption, access control, and governance practices.
Optimize performance of ETL pipelines and Spark‑based workloads for scalability and cost efficiency.
Collaborate with team members and stakeholders to deliver reliable and high‑quality data solutions.
Develop and maintain CI / CD pipelines for data workflows using Azure DevOps or similar tools.
Monitor and troubleshoot data pipelines, ensuring high availability and reliability of data processes.
Contribute to the development of best practices, coding standards, and documentation for the data engineering function.

Required Skills & Experience

3–6 years of experience in Data Engineering or a similar role.

Bachelor's Degree in Computer Science, Information Systems, Engineering or other related fields.

Strong hands‑on experience with Azure Data Factory (ADF) – pipeline orchestration, data movement, and workflow automation.

Azure Data Lake Storage (ADLS) – data partitioning, lifecycle management, and access control.

Databricks (PySpark / Spark SQL) – data processing, optimization, and notebook development.

Expertise in data modelling, ETL / ELT processes, and data integration patterns.

Solid understanding of Azure security principles (RBAC, managed identities, encryption, VNETs, etc.).

Proven ability in performance tuning of data pipelines.

Proficiency with SQL and one or more programming languages (Python, Scala).

Familiarity with CI / CD pipelines, Git, and Azure DevOps.

Experience implementing data quality and monitoring.

Preferred Qualifications

Microsoft Certified : Azure Data Engineer Associate or equivalent certification.

Experience with Delta Lake, Synapse Analytics, or Power BI integration.

Knowledge of modern data architectures and data governance.

Soft Skills

Strong analytical and problem‑solving mindset.

Excellent communication and collaboration skills.

Ability to work independently and manage multiple priorities.

Passion for innovation and continuous learning in the data engineering space.

Seniority Level

Mid‑Senior level

Employment Type

Contract

Job Function

Information Technology

Industries

IT Services and IT Consulting

Referrals increase your chances of interviewing at AT Global Consulting Sdn Bhd by 2x.

#J-18808-Ljbffr

Buat amaran kerja untuk carian ini

Data Engineer • Kuala Lumpur, Kuala Lumpur, Malaysia

Pekerjaan yang berkaitan

Dinaikkan pangkat

Senior Data Engineer, Platform

Ryt BankKuala Lumpur, Kuala Lumpur, Malaysia

Direct message the job poster from Ryt Bank.AI-powered digital bank, proudly awarded as one of the five digital banking license winners by BNM in Malaysia! Formed by the consortium of YTL Digital C...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu

Dinaikkan pangkat

Data Engineer

Logicalis Asia PacificKuala Lumpur, Kuala Lumpur, Malaysia

Join to apply for the Data Engineer role at Logicalis Asia Pacific.Zeno was founded in 2003 to provide enterprises with custom-built technology solutions they need to keep their business running se...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu

Dinaikkan pangkat
Baharu!

Data Engineer

Dexian Asia PacificKuala Lumpur, Kuala Lumpur, Malaysia

Talent Acquisition || APAC || Semi Conductor || Oil and Gas || Textile.Person with strong expertise in data integration, cloud platforms, and database management to support and enhance manufacturin...Tunjukkan lagiKemas kini terakhir: 9 jam yang lalu

Dinaikkan pangkat

Senior Azure Cloud Engineer

Logicalis Group (DE)Putrajaya, Putrajaya, Malaysia

Senior Azure Cloud Engineer in Putrajaya at Logicalis.Tunjukkan lagiKemas kini terakhir: 11 hari yang lalu

Dinaikkan pangkat

Data Engineer

Sime MotorsPetaling Jaya, Selangor, Malaysia

Deliver technology solutions to meet business requirements.Create, maintain, and monitor data pipelines, ensuring high quality and effective governance. Design and optimize database structures for p...Tunjukkan lagiKemas kini terakhir: 1 hari yang lalu

Dinaikkan pangkat

Senior Data Engineer

FWD Group Management Holdings LimitedKuala Lumpur, Kuala Lumpur, Malaysia

Senior Data Engineer page is loaded## Senior Data Engineerlocations : Malaysia - KL Eco Citytime type : Full timeposted on : Posted Todaytime left to apply : End Date : September 23, 2026 (30+ d...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu

Consultant - Data Engineer

Intelligen GroupKuala Lumpur, Federal Territory of Kuala Lumpur, MY

Quick Apply

At Intelligen, we’re building something different.Over the past three years, we’ve evolved from a bold startup into a trusted partner for some of Australia’s most complex data transformations.We’ve...Tunjukkan lagiKemas kini terakhir: 9 hari yang lalu

Dinaikkan pangkat

Data Engineer

WascoKuala Lumpur, Kuala Lumpur, Malaysia

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia.Direct message the job poster from Wasco.Human Resources Manager at Wasco Energy Group of Companies. IT&D department is now embarking on a j...Tunjukkan lagiKemas kini terakhir: 2 hari yang lalu

Dinaikkan pangkat

Data Engineer

InfosysSelangorMalaysia, Selangor, Malaysia

Build, test, and maintain ingestion and transformation pipelines in Databricks.Implement business logic and transformations using DBT or Coalesce. Handle data wrangling, cleansing, and CDC-based inc...Tunjukkan lagiKemas kini terakhir: 2 hari yang lalu

Dinaikkan pangkat

Senior Azure Cloud Engineer

Logicalis Asia PacificCyberjaya, Selangor, Malaysia

Continue with Google Continue with Google.Be among the first 25 applicants.Join Us as a Senior Azure Engineer and Help Drive Cloud Excellence. In this pivotal role, you will be responsible for suppo...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu

Dinaikkan pangkat

Data Engineer

Tata Consultancy ServicesKuala Lumpur, Kuala Lumpur, Malaysia

Data Engineer with expertise in AWS Glue, Python and AWS Transfer Family responsible for designing, building, and maintaining robust and efficient data pipelines for ingesting data into cloud-based...Tunjukkan lagiKemas kini terakhir: 1 hari yang lalu

Dinaikkan pangkat

Data Engineer, Ikano Retail

Ikano Bank ABPetaling Jaya, Selangor, Malaysia

The IKEA vision is to create a better everyday life for the many people.We do this by offering a wide range of well-designed, functional home furnishing products at prices so low that as many peopl...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu

Senior / Mid Data Engineer (ZALORA)

GLOBAL FASHION GROUP SGP SERVICES PTE LTD.Kuala Lumpur, Kuala Lumpur, MY

Quick Apply

ZALORA Group is looking for a Senior Data Engineer to join its Data Science Team.As a Senior Data Engineer, you will : Work daily with machine learning problems.For this purpose, y...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu

Dinaikkan pangkat

Data Engineer - Snowflake

CollaberaShah Alam, Selangor, Malaysia

Manage and monitor the performance of the Modern Data Stack (MDS).Troubleshoot any issues or discrepancies within the data infrastructure. Develop and enforce robust security protocols to protect se...Tunjukkan lagiKemas kini terakhir: 23 hari yang lalu

Dinaikkan pangkat

Data Engineer

RHB Banking GroupKuala Lumpur, Kuala Lumpur, Malaysia

End-to-End Data Product Pipelines - Design, build, and maintain robust data pipelines that ingest, process, transform, and deliver Data Products for analytics, reporting, and operational use cases....Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu

Dinaikkan pangkat

Data Engineer

Involve AsiaKuala Lumpur, Kuala Lumpur, Malaysia

Involve Asia is seeking a Data Engineer who will be responsible for supporting data analysts and software engineers by providing maintainable infrastructure and tooling to deliver end-to-end soluti...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu

Dinaikkan pangkat

Databricks Data Engineer

AvanadeKuala Lumpur, Kuala Lumpur, Malaysia

Databricks Data Engineer – Avanade.Avanade Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia.Our talented Data & AI Practice is made up of globally recognized experts and offers a space for...Tunjukkan lagiKemas kini terakhir: 7 hari yang lalu

Dinaikkan pangkat

Data Engineer

Ad Astra ConsultantsKuala Lumpur, Kuala Lumpur, Malaysia

We are seeking a highly skilled Data Engineer with strong expertise in data processing, database technologies, and Databricks development. The ideal candidate will be responsible for building, optim...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu