Tawaran kerja ini tidak tersedia di negara anda.
Bigdata Engineer
Datadot Software SolutionKuala Lumpur, Kuala Lumpur, Malaysia22 jam yang lalu
Penerangan pekerjaanBachelor's, Master's, or PhD in Computer Science, Data Engineering, or a related discipline. 3–7 years of experience in data engineering and distributed data systems. Strong hands-on experience with Apache Hive, HBase, Kafka, Solr, Elasticsearch. Proficient in data architecture, data modelling, and pipeline scheduling / orchestration. Operational experience with Data Mesh, Data Product development, and hybrid cloud data platforms. Familiarity with CRM systems, including CRM system, and data sourcing / mapping strategies. Proficient in managing metadata, glossary, and lineage tools like Apache Atlas. Proven experience in generating large-scale batch files using Spark and Hive. Strong understanding of document-based data models and the transformation of relational schemas into document-oriented structures. Expertise in data administration, modelling, mapping, collection, and distribution. Strong understanding of business workflows to support metadata governance. Hands-on experience with analytics and DWH tools (e.g., SAS, Oracle, MS SQL, Python, R Programming). Familiarity with data modelling tools (e.g., ERWIN), and enterprise databases (Oracle, IBM DB2, MS SQL, Hadoop, Object Store). Experience working across hybrid cloud environments (e.g., AWS, Azure Data Factory). In-depth knowledge of ETL / ELT processes and automation frameworks. Analytical thinker with strong problem-solving and communication skills. Able to collaborate effectively across technical and business teams.
Key Responsibilities
- Design and evolve the overall data architecture, ensuring scalability, flexibility, and compliance with enterprise standards.
- Build efficient, secure, and reliable data pipelines using the Bronze-Silver-Gold architecture within EDL.
- Develop and orchestrate scheduled jobs in the EDL environment to support continuous ingestion and transformation.
- Implement Apache Iceberg for data versioning, governance, and optimization.
- Leverage the Medallion framework to standardize data product maturity and delivery.
- Govern metadata, data lineage, and business glossary using tools like Apache Atlas.
- Ensure data security, privacy, and regulatory compliance across all data processes.
- Support Data Mesh principles by collaborating with domain teams to design and implement reusable Data Products.
- Integrate data across structured, semi-structured, and unstructured sources from enterprise systems such as ODS and CRM systems.
- Drive adoption of DataOps / MLOps best practices and mentor peers across units.
- Generate and manage large-scale batch files using Spark and Hive for high-volume data processing.
- Design and implement document-based data models and transform relational models into NoSQL document-oriented structures (eg NoSQL Database or similar system).
Required Skills & Qualifications
Additional Technical & Business Competencies
Buat amaran kerja untuk carian ini
Engineer • Kuala Lumpur, Kuala Lumpur, Malaysia
Pekerjaan yang berkaitan
![[KYDP 2025 - Cohort 5] Junior Data Engineer](https://cdn-logos.talent.com/v1/logo/image?feedcode=whatjobs-my&company_name=TalentLabs)
ZALORA Group is looking for a Senior Data Engineer to join its Data Science Team.As a Senior Data Engineer, you will : Work daily with machine learning problems.For this purpose, y...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu
Greater Kuala Lumpur, Malaysia.Our client is a global leader in sustainable building materials, generating multi-billion annual revenue with operations in over 40 countries and a workforce exc...Tunjukkan lagiKemas kini terakhir: 13 hari yang lalu
It isn’t often you get to be part of a tech company that, since 2016, has been innovating the data analytics market in ways no-one else can.
Our technology started out in FinTech, helping tackle ser...Tunjukkan lagiKemas kini terakhir: 20 hari yang lalu
- Dinaikkan pangkat
Elastic Engineer
Encora Inc.Kuala Lumpur, Kuala Lumpur, Malaysia Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia.Summary : Experienced Elastic Engineer to design, deploy, manage, and optimize our Elastic Stack infrastructure.
Will work closely with cross...Tunjukkan lagiKemas kini terakhir: 1 hari yang lalu
- Dinaikkan pangkat
Senior Manager - Data Analytics
AIA Hong KongKuala Lumpur, Kuala Lumpur, Malaysia We don’t simply believe in being ‘The Best’.We believe in better - because there’s no limit to how far ‘better’ can take us.
We believe in empowering every one of our people to find their 'better' -...Tunjukkan lagiKemas kini terakhir: 1 hari yang lalu
- Dinaikkan pangkat
Data Engineer (Azure and PowerBI)
Procter & GambleKuala Lumpur, Kuala Lumpur, Malaysia Would you like to harness the power of Information Technology through combining breakthrough technology and business consulting with our business teams?.
Then a career in our P&G IT Function is just...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu
- Dinaikkan pangkat
[KYDP 2025 - Cohort 5] Junior Data Engineer
TalentLabsSelangorMalaysia, Selangor, Malaysia KYDP 2025 - Cohort 5) Junior Data Engineer.Data Analytics, Prompt Engineering & Machine Learning.As a Data & AI Specialist, you will support the development, deployment, and maintenance of data-dri...Tunjukkan lagiKemas kini terakhir: 1 hari yang lalu
- Dinaikkan pangkat
Senior AI Reporting Engineer
Razer Inc.Kuala Lumpur, Kuala Lumpur, Malaysia Bangsar South, Federal Territory of Kuala Lumpur, Malaysia.Job title : Senior Data Analyst – Risk and Compliance (Razer Gold).
Razer Gold aims to become the world’s leading payment service provider f...Tunjukkan lagiKemas kini terakhir: 3 hari yang lalu
- Dinaikkan pangkat
Data Analyst
Talent, Inc.Klang Municipal Council, Klang Municipal Council, Malaysia We’re committed to helping job seekers write the next chapter of their careers and we want to help write yours, too! We hire for growth and longevity because we value the happiness and well-being o...Tunjukkan lagiKemas kini terakhir: 1 hari yang lalu
Senior Data Engineer
ZALORA SOUTH EAST ASIA PTE LTDKuala Lumpur, Kuala Lumpur, MYQuick Apply
- Dinaikkan pangkat
- Baharu!
Senior Data Engineer
RevolabNovotel Kuala Lumpur City Centre, Kuala Lumpur, Malaysia Most of the world's most powerful AI models are built on clean, structured data.But what about the vast, unstructured ocean of information that surrounds us—the photos, podcasts, and videos that de...Tunjukkan lagiKemas kini terakhir: 22 jam yang lalu
Data Engineer - Snowflake
Oxydata SoftwareKuala Lumpur, MalaysiaQuick Apply
- Dinaikkan pangkat
- Baharu!
Data Engineer, Contract, KL (RM4,000 - RM6,000)
Agensi Perkejaan Hunters SearchKuala Lumpur, Kuala Lumpur, Malaysia We are seeking a skilled Data Engineer to design, build, and maintain robust data pipelines and infrastructure.The ideal candidate will have experience in data processing, ETL development, and data...Tunjukkan lagiKemas kini terakhir: 22 jam yang lalu
- Dinaikkan pangkat
Senior BI Engineer
BASSnetKuala Lumpur, Kuala Lumpur, Malaysia We’re looking for a Senior BI Engineer to design and develop enterprise-level BI solutions that enable data-driven decision-making.
You will be at the intersection of data engineering and business a...Tunjukkan lagiKemas kini terakhir: 25 hari yang lalu
- Dinaikkan pangkat
Data Engineer (Analytics)
Experian GroupCyberjaya, Selangor, Malaysia The role sits within our Decision Analytics, one of our four Global Business Lines.Experian Decision Analytics helps clients achieve and sustain significant growth.
We do this by enabling clients to...Tunjukkan lagiKemas kini terakhir: 1 hari yang lalu
- Dinaikkan pangkat
Remote Senior DevOps Engineer - CoinGecko
Blockchain WorksSelayang Municipal Council, Selayang Municipal Council, Malaysia CoinGecko is a global leader in tracking cryptocurrency data.Operating since 2014, CoinGecko has built the world's largest cryptocurrency data platform, tracking over 10,000 tokens across more than...Tunjukkan lagiKemas kini terakhir: 1 hari yang lalu
- Dinaikkan pangkat
- Baharu!
Senior Data Engineer
QuandaticsKuala Lumpur, Kuala Lumpur, Malaysia The Senior Data Engineer plays a key role in designing, building, and optimizing data solutions.This role involves leading and guiding a team of data engineers while working on data architecture, E...Tunjukkan lagiKemas kini terakhir: 22 jam yang lalu
- Dinaikkan pangkat
Senior Data Engineer
Kris Infotech Sdn BhdKuala Lumpur, Kuala Lumpur, Malaysia Python, PySpark, and Databricks.This opportunity is open to Malaysian citizens due to project requirements.Design, develop, and maintain data pipelines and ETL processes.
Collaborate with data scien...Tunjukkan lagiKemas kini terakhir: 3 hari yang lalu
- Dinaikkan pangkat
Data Analysis Engineer
iSoftStoneKuala Lumpur, Kuala Lumpur, Malaysia HR & Talent Acquisition Professional | 7+ Years’ Experience | Open for New Roles.Responsible for overseas mobile game business related security strategy development, operation, videos analysis, rel...Tunjukkan lagiKemas kini terakhir: 3 hari yang lalu
- Dinaikkan pangkat
Senor Data Engineer
TwinPacsKuala Lumpur, Kuala Lumpur, Malaysia This role is open for Locals residents & MyPR (redcard) holders only.Minimum 3-5 years of experience in data engineering, with at least 2 years working in cloud-based environments (preferably A...Tunjukkan lagiKemas kini terakhir: 15 hari yang lalu
- Dinaikkan pangkat
Analytics Engineer
DataLaksa Sdn BhdPetaling Jaya, Selangor, Malaysia This is a full-time hybrid role for an Analytics Engineer at DataLaksa Sdn Bhd.The role is based in Petaling Jaya, Malaysia, with some work-from-home flexibility.
Design, develop, and maintain data ...Tunjukkan lagiKemas kini terakhir: 1 hari yang lalu
- Dinaikkan pangkat
- Baharu!
Senior Data Engineer
Evoloper Sdn BhdSubang Jaya, Kuala Lumpur, Malaysia Data Engineering : Design, build, and optimize scalable ETL / ELT Processes to ensure high-quality, accessible data.Machine Learning : Research, develop, deploy, and optimize Machine Learning (ML) and ...Tunjukkan lagiKemas kini terakhir: 22 jam yang lalu
Senior Data Engineer
QuantexaKuala Lumpur, Federal Territory of Kuala Lumpur, MYQuick Apply