Tawaran kerja ini tidak tersedia di negara anda.
Senior Data Engineer
CapgeminiKuala Lumpur, Kuala Lumpur, Malaysia21 hari lalu
Penerangan pekerjaanBachelor's, Master’s, or PhD in Computer Science, Data Engineering, or a related discipline. 5–7 years of experience in data engineering and distributed data systems. Strong hands-on experience with Apache Hive, HBase, Kafka, Solr, Elasticsearch. Proficient in data architecture, data modelling, and pipeline scheduling / orchestration. Operational experience with Data Mesh, Data Product development, and hybrid cloud data platforms. Familiarity with CRM systems and data sourcing / mapping strategies. Proficient in managing metadata, glossary, and lineage tools like Apache Atlas. Proven experience in generating large-scale batch files using Spark and Hive. Strong understanding of document-based data models and the transformation of relational schemas into document-oriented structures. Expertise in data administration, modelling, mapping, collection, and distribution. Strong understanding of business workflows to support metadata governance. Hands-on experience with analytics and DWH tools (e.g., SAS, Oracle, MS SQL, Python, R Programming). Familiarity with data modelling tools (e.g., ERWIN), and enterprise databases (Oracle, IBM DB2, MS SQL, Hadoop, Object Store). Experience working across hybrid cloud environments (e.g., AWS, Azure Data Factory). In-depth knowledge of ETL / ELT processes and automation frameworks. Analytical thinker with strong problem-solving and communication skills. Able to collaborate effectively across technical and business teams. Proven ability to deliver high-quality outcomes within defined project timelines. Seniority level : Mid-Senior level Employment type : Full-time Job function : Consulting and Product Management Industries : Banking
Overview
Senior Data Engineer role at Capgemini in the Federal Territory of Kuala Lumpur, Malaysia. We are seeking an experienced and highly skilled Senior Data Engineer to lead the design, development, and optimization of scalable data engineering solutions across our Enterprise Data Lake (EDL) and hybrid data platforms. This role provides technical leadership in data architecture, pipeline orchestration, metadata governance, and data product development, with a strong emphasis on aligning engineering practices with business goals. The ideal candidate will demonstrate a deep understanding of modern data technologies, data modelling, and data governance frameworks.
Key Responsibilities
- Design and evolve the overall data architecture, ensuring scalability, flexibility, and compliance with enterprise standards.
- Build efficient, secure, and reliable data pipelines using the Bronze-Silver-Gold architecture within EDL.
- Develop and orchestrate scheduled jobs in the EDL environment to support continuous ingestion and transformation.
- Implement Apache Iceberg for data versioning, governance, and optimization.
- Leverage the Medallion framework to standardize data product maturity and delivery.
- Govern metadata, data lineage, and business glossary using tools like Apache Atlas.
- Ensure data security, privacy, and regulatory compliance across all data processes.
- Support Data Mesh principles by collaborating with domain teams to design and implement reusable Data Products.
- Integrate data across structured, semi-structured, and unstructured sources from enterprise systems such as ODS and CRM systems.
- Drive adoption of DataOps / MLOps best practices and mentor peers across units.
- Generate and manage large-scale batch files using Spark and Hive for high-volume data processing.
- Design and implement document-based data models and transform relational models into NoSQL document-oriented structures (for example NoSQL databases or similar systems).
Required Skills & Qualifications
Additional Technical & Business Competencies
Employment details
#J-18808-Ljbffr
Buat amaran kerja untuk carian ini
Senior Data Engineer • Kuala Lumpur, Kuala Lumpur, Malaysia
Pekerjaan yang berkaitan
Hiring Local Malaysians only - CONTRACT JOB - 12 MONTHS (EXTENDABLE).DATA ENGINEER - IT with Extensive experience in "Healthcare ".
With Minimum Experience - 3 years & Maximun Experience - 15 ye...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu)
Responsibilities : Work closely with Product and UX Research teams to design and develop features for the iOS platform.Collaborate with back-end developers to enhance usability,...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu ZALORA Group is looking for a Senior Data Engineer to join its Data Science Team.As a Senior Data Engineer, you will : Work daily with machine learning problems.For this purpose, y...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu 
Greater Kuala Lumpur, Malaysia.Our client is a global leader in sustainable building materials, generating multi-billion annual revenue with operations in over 40 countries and a workforce exc...Tunjukkan lagiKemas kini terakhir: 9 hari yang lalu
Must have experience in Dell EMC Storage technologies such as Dell EMC Unity, VMAX, PMAX.Must have experience with Pure Storage arrays like X70, X90 provisioning and storage protection groups &...Tunjukkan lagiKemas kini terakhir: 16 hari yang lalu
It isn’t often you get to be part of a tech company that, since 2016, has been innovating the data analytics market in ways no-one else can.
Our technology started out in FinTech, helping tackle ser...Tunjukkan lagiKemas kini terakhir: 15 hari yang lalu
Funding Societies | Modalku is the largest SME digital finance platform in Southeast Asia.We are licensed and operating in Singapore, Indonesia, Thailand, Malaysia and Vietnam, and backed by ...Tunjukkan lagiKemas kini terakhir: 5 hari yang lalu
ZALORA Group is looking for a Senior Data Engineer to join its Data Science Team.As a Senior Data Engineer, you will : Work daily with machine learning problems.For this purpose, y...Tunjukkan lagiKemas kini terakhir: 9 hari yang lalu
Drive the full lifecycle of Data Science projects : from gathering and understanding the end-user needs to implement a fully automated solution.
Develop and provision of Data pipelines to enable self...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu 
ThoughtFull is on a mission to simplify mental health for your personal and professional growth - through every season of life, anytime, anywhere.
ThoughtFull is a Temasek-backed mental health compa...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu We currently have an opening for a DevOps.You will cooperate with interdisciplinary teams in projects.Maintain a secure and reliable infrastructure for delivery services.
Operate and maintaining pro...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu It isn’t often you get to be part of a tech company that, since 2016, has been innovating the data analytics market in ways no-one else can.
Our technology started out in FinTech, helping tackle ser...Tunjukkan lagiKemas kini terakhir: 16 hari yang lalu 
Backed by Ant International (a global leader in digital payments, digitisation, and financial technology solutions) EPOS, part of its global merchant payment services Antom, is a leading Point-of-S...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu
Data Engineer
Two95 International Inc.Kuala Lumpur, Federal Territory of Kuala Lumpur, MYQuick Apply
- Dinaikkan pangkat
QA Engineer - Data Lake
PayNet (Payments Network Malaysia)Kuala Lumpur, Kuala Lumpur, Malaysia As a QA Engineer, you will play a critical role in designing, developing, and implementing automated testing frameworks to ensure the quality and reliability of our data-driven applications and API...Tunjukkan lagiKemas kini terakhir: 22 hari yang lalu
- Dinaikkan pangkat
(Chinese and English) Customer Support Consultant, crypto (remote)
SupportYourAppKuala Selangor, Kuala Selangor, Malaysia Passionate about the world of tech?.What if you had a chance to be a part of the world's leading SaaS, Software, or Hardware solutions?.
Unlock your potential by mastering new skills and achieving c...Tunjukkan lagiKemas kini terakhir: 16 hari yang lalu
Senior Software Engineer II
ZALORA SOUTH EAST ASIA PTE LTDKuala Lumpur, MYQuick Apply
Senior Data Engineer
ZALORA SOUTH EAST ASIA PTE LTDKuala Lumpur, Kuala Lumpur, MYQuick Apply
Data Engineer - Snowflake
Oxydata SoftwareKuala Lumpur, MalaysiaQuick Apply
Senior Data Protection Engineer Level 3
Unison GroupKuala Lampur, Kuala Lumpur, MYQuick Apply
Lead Data Engineer
QuantexaKuala Lumpur, Federal Territory of Kuala Lumpur, MYQuick Apply
- Dinaikkan pangkat
Azure Data Engineer
Avanade Inc.Kuala Lumpur, Malaysia Utilise modern data engineering techniques with Advanced Analytics to support Avanade clients' business decisions.Design and build data pipelines, data streams, and reporting tools for insightful d...Tunjukkan lagiKemas kini terakhir: 2 hari yang lalu
- Dinaikkan pangkat
Senior Subsea Engineer
McDermottKuala Lumpur, Malaysia The Senior Subsea Engineer uses best practices and knowledge of internal or external issues to improve the Subsea discipline within McDermott.
They will act as a resource for colleagues with less ex...Tunjukkan lagiKemas kini terakhir: 2 hari yang lalu
Senior Data Analyst - Growth
Funding Societies | Modalku GroupKuala Lumpur, Federal Territory of Kuala Lumpur, MYQuick Apply
Senior / Mid Data Engineer (ZALORA)
GLOBAL FASHION GROUP SGP SERVICES PTE LTD.Kuala Lumpur, Kuala Lumpur, MYQuick Apply
- Dinaikkan pangkat
Data Engineer
Fairview International SchoolKuala Selangor, Malaysia We are a digital health therapeutics company operating across SEA, focused on the intersection of mental health and physical chronic diseases.
We combine behavioral science, psychology, data science...Tunjukkan lagiKemas kini terakhir: 2 hari yang lalu
- Dinaikkan pangkat
Senor Data Engineer
TwinPacsKuala Lumpur, Kuala Lumpur, Malaysia This role is open for Locals residents & MyPR (redcard) holders only.Minimum 3-5 years of experience in data engineering, with at least 2 years working in cloud-based environments (preferably A...Tunjukkan lagiKemas kini terakhir: 11 hari yang lalu
Hiring for Data Engineer / Data Scientist
Two95 International Inc.Kuala Lumpur, Federal Territory of Kuala Lumpur, MYQuick Apply
Senior Data Analyst
ThoughtFull WorldKuala Lumpur, Federal Territory of Kuala Lumpur, MYQuick Apply
Lead / Senior DevOps Engineer
Two95 International Inc.Kuala Lumpur, Federal Territory of Kuala Lumpur, MYQuick Apply
Senior Data Engineer
QuantexaKuala Lumpur, Federal Territory of Kuala Lumpur, MYQuick Apply
- Dinaikkan pangkat
Business Analytics Engineer (Remote)
Bluesky HR Consultancy Inc.Kuala Selangor, Malaysia We are hiring an ML / Data Engineer to support our data science and analytics initiatives.This role is responsible for performing data cleaning and transformation, and implementing scalable modeling ...Tunjukkan lagiKemas kini terakhir: 2 hari yang lalu
Data and Automation Engineer
EPOSKuala Lumpur, Federal Territory of Kuala Lumpur, MYQuick Apply