Tawaran kerja ini tidak tersedia di negara anda.
Bigdata Engineer
Datadot Software SolutionKuala Lumpur, Kuala Lumpur, Malaysia1 hari lalu
Penerangan pekerjaanBachelor's, Master's, or PhD in Computer Science, Data Engineering, or a related discipline. 3–7 years of experience in data engineering and distributed data systems. Strong hands-on experience with Apache Hive, HBase, Kafka, Solr, Elasticsearch. Proficient in data architecture, data modelling, and pipeline scheduling / orchestration. Operational experience with Data Mesh, Data Product development, and hybrid cloud data platforms. Familiarity with CRM systems, including CRM system, and data sourcing / mapping strategies. Proficient in managing metadata, glossary, and lineage tools like Apache Atlas. Proven experience in generating large-scale batch files using Spark and Hive. Strong understanding of document-based data models and the transformation of relational schemas into document-oriented structures. Expertise in data administration, modelling, mapping, collection, and distribution. Strong understanding of business workflows to support metadata governance. Hands-on experience with analytics and DWH tools (e.g., SAS, Oracle, MS SQL, Python, R Programming). Familiarity with data modelling tools (e.g., ERWIN), and enterprise databases (Oracle, IBM DB2, MS SQL, Hadoop, Object Store). Experience working across hybrid cloud environments (e.g., AWS, Azure Data Factory). In-depth knowledge of ETL / ELT processes and automation frameworks. Analytical thinker with strong problem-solving and communication skills. Able to collaborate effectively across technical and business teams.
Key Responsibilities
- Design and evolve the overall data architecture, ensuring scalability, flexibility, and compliance with enterprise standards.
- Build efficient, secure, and reliable data pipelines using the Bronze-Silver-Gold architecture within EDL.
- Develop and orchestrate scheduled jobs in the EDL environment to support continuous ingestion and transformation.
- Implement Apache Iceberg for data versioning, governance, and optimization.
- Leverage the Medallion framework to standardize data product maturity and delivery.
- Govern metadata, data lineage, and business glossary using tools like Apache Atlas.
- Ensure data security, privacy, and regulatory compliance across all data processes.
- Support Data Mesh principles by collaborating with domain teams to design and implement reusable Data Products.
- Integrate data across structured, semi-structured, and unstructured sources from enterprise systems such as ODS and CRM systems.
- Drive adoption of DataOps / MLOps best practices and mentor peers across units.
- Generate and manage large-scale batch files using Spark and Hive for high-volume data processing.
- Design and implement document-based data models and transform relational models into NoSQL document-oriented structures (eg NoSQL Database or similar system).
Required Skills & Qualifications
Additional Technical & Business Competencies
Buat amaran kerja untuk carian ini
Engineer • Kuala Lumpur, Kuala Lumpur, Malaysia
Pekerjaan yang berkaitan
![[KYDP 2025 - Cohort 5] Junior Data Engineer](https://cdn-logos.talent.com/v1/logo/image?feedcode=whatjobs-my&company_name=TalentLabs)
ZALORA Group is looking for a Senior Data Engineer to join its Data Science Team.As a Senior Data Engineer, you will : Work daily with machine learning problems.For this purpose, y...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu
Greater Kuala Lumpur, Malaysia.Our client is a global leader in sustainable building materials, generating multi-billion annual revenue with operations in over 40 countries and a workforce exc...Tunjukkan lagiKemas kini terakhir: 13 hari yang lalu
- Dinaikkan pangkat
Associate - Data Engineer
PwC SingaporeKuala Lumpur, Kuala Lumpur, Malaysia We believe that challenges are best solved together.That's why, when you join us, you become part of a diverse and global community of problem-solvers.
You'll find an unexpected mix of people who br...Tunjukkan lagiKemas kini terakhir: 1 hari yang lalu
- Dinaikkan pangkat
Data Engineer (Azure and PowerBI)
Procter & GambleKuala Lumpur, Kuala Lumpur, Malaysia Would you like to harness the power of Information Technology through combining breakthrough technology and business consulting with our business teams?.
Then a career in our P&G IT Function is just...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu
- Dinaikkan pangkat
[KYDP 2025 - Cohort 5] Junior Data Engineer
TalentLabsSelangorMalaysia, Selangor, Malaysia KYDP 2025 - Cohort 5) Junior Data Engineer.Data Analytics, Prompt Engineering & Machine Learning.As a Data & AI Specialist, you will support the development, deployment, and maintenance of data-dri...Tunjukkan lagiKemas kini terakhir: 1 hari yang lalu
Senior Data Engineer
ZALORA SOUTH EAST ASIA PTE LTDKuala Lumpur, Kuala Lumpur, MYQuick Apply
- Dinaikkan pangkat
Senior Data Engineer
CFI Financial GroupKlang, Selangor, Malaysia CFI Financial Group is an award-winning trading provider, possessing more than 25 years of experience with multiple offices around the world including London, Larnaca, Beirut, Amman, Dubai, Kuwait,...Tunjukkan lagiKemas kini terakhir: 1 hari yang lalu
Data Engineer - Snowflake
Oxydata SoftwareKuala Lumpur, MalaysiaQuick Apply
- Dinaikkan pangkat
Data Engineer, Contract, KL (RM4,000 - RM6,000)
Agensi Perkejaan Hunters SearchKuala Lumpur, Kuala Lumpur, Malaysia We are seeking a skilled Data Engineer to design, build, and maintain robust data pipelines and infrastructure.The ideal candidate will have experience in data processing, ETL development, and data...Tunjukkan lagiKemas kini terakhir: 1 hari yang lalu
- Dinaikkan pangkat
Data Engineer
KewMannKuala Lumpur, Kuala Lumpur, Malaysia The ideal candidate's favorite words are learning, data, scale, and agility.You will leverage your strong collaboration skills and ability to extract valuable insights from highly complex data sets...Tunjukkan lagiKemas kini terakhir: 1 hari yang lalu
- Dinaikkan pangkat
Data Engineer
Link ComplianceKuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia My client is one of the leading digital banks in Malaysia.Design, develop, and maintain reliable and scalable data pipelines using Apache Airflow.
Implement data ingestion, transformation, and valid...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu
- Dinaikkan pangkat
Data Engineer
TENTACLE TECH SSO SDN BHDBangsar, Kuala Lumpur, Malaysia Location : Bangsar South, Kuala Lumpur.Experience with Python, R, or other similar languages.Experience with DevOps methodologies.
Experience with cloud-based data platforms and Azure cloud technolog...Tunjukkan lagiKemas kini terakhir: 1 hari yang lalu
- Dinaikkan pangkat
Data Engineer
GUINEVERE GLOBAL SDN. BHD.Bangsar, Kuala Lumpur, Malaysia Juno Markets is dedicated to providing an online trading environment with an array of financial products, advanced technology, and personalized service.
We aim to empower traders with tools to succe...Tunjukkan lagiKemas kini terakhir: 1 hari yang lalu
- Dinaikkan pangkat
Big Data Engineer
Beyondsoft MalaysiaKuala Lumpur, Kuala Lumpur, Malaysia ETL & Data Pipeline Development (80%) : Design and implement ETL processes, data pipeline development, and data warehouse management using Airflow, Spark, and Python / Java.
Data Extraction (20%) : Prov...Tunjukkan lagiKemas kini terakhir: 1 hari yang lalu
- Dinaikkan pangkat
Senior Data Engineer
QuandaticsKuala Lumpur, Kuala Lumpur, Malaysia The Senior Data Engineer plays a key role in designing, building, and optimizing data solutions.This role involves leading and guiding a team of data engineers while working on data architecture, E...Tunjukkan lagiKemas kini terakhir: 1 hari yang lalu
- Dinaikkan pangkat
Data Engineer
PropertyGuru GroupKuala Lumpur, Kuala Lumpur, Malaysia PropertyGuru is Southeast Asia's leading PropTech company, and the preferred destination for over 32 million property seekers monthly to connect with over 50,000 agents monthly to find their dream ...Tunjukkan lagiKemas kini terakhir: 25 hari yang lalu
- Dinaikkan pangkat
Senior Big Data Engineer
POWER IT SERVICESKuala Lumpur, Kuala Lumpur, Malaysia Required Skills & Qualifications.Bachelor's, Master's, or PhD in Computer Science, Data Engineering, or a related discipline.
Strong hands-on experience with Apache Hive, HBase, Kafka, Solr, Elastic...Tunjukkan lagiKemas kini terakhir: 1 hari yang lalu
- Dinaikkan pangkat
Mid-Level Role : Data Engineer
GoCode Pte LtdLapangan Terbang Antarabangsa Kuala Lumpur, Selangor, Malaysia We're looking for a Data Engineer who can both code backend services in Golang and work with modern data warehouses / OLAP systems (e.
BigQuery, StarRocks, ClickHouse, Snowflake) to support high-vol...Tunjukkan lagiKemas kini terakhir: 1 hari yang lalu
- Dinaikkan pangkat
Data Engineer
DATABRICKS TECH SDN. BHD.Kuala Lumpur, Kuala Lumpur, Malaysia We are seeking a skilled Data Engineer to manage, secure, and transform data from various systems into our data warehouse.
The ideal candidate will facilitate data integration, ensure accuracy, and ...Tunjukkan lagiKemas kini terakhir: 1 hari yang lalu
- Dinaikkan pangkat
Senior Data Engineer
Evoloper Sdn BhdSubang Jaya, Kuala Lumpur, Malaysia Data Engineering : Design, build, and optimize scalable ETL / ELT Processes to ensure high-quality, accessible data.Machine Learning : Research, develop, deploy, and optimize Machine Learning (ML) and ...Tunjukkan lagiKemas kini terakhir: 1 hari yang lalu