Moving Walls GroupKuala Lumpur, Kuala Lumpur, Malaysia
30+ days ago
Job description
Responsibilities
Create and maintain the optimal data pipeline architecture.
Assemble large, complex data sets that meet functional / non-functional business requirements.
Identify, design, and implement internal process improvements : automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS ‘big data’ technologies.
Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics.
Work with stakeholders including the Executive, Product, Data, and Design teams to assist with data-related technical issues and support their data infrastructure needs.
Keep our data separated and secure across national boundaries through multiple data centers and AWS regions.
Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
Work with data and analytics experts to strive for greater functionality in our data systems.
Qualifications for Data Engineer
We are looking for a candidate with 5+ years of experience in a Data Engineer role, who has attained a Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field. They should also have experience using the following software / tools :
Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
Experience building and optimizing ‘big data’ data pipelines, architectures, and data sets.
Experience performing root cause analysis of internal and external data and processes to answer specific business questions and identify opportunities for improvement.
Strong analytic skills related to working with unstructured data sets.
Build processes supporting data transformation, data structures, metadata, dependency, and workload management.
A successful history of manipulating, processing, and extracting value from large disconnected datasets.
Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.
Strong project management and organizational skills.
Experience supporting and working with cross-functional teams in a dynamic environment.
Experience with big data tools : Hadoop, Spark, Kafka, etc.
Experience with relational SQL and NoSQL databases, including MongoDB, Postgres, and Cassandra, AWS Redshift, Snowflake.
Experience with data pipeline and workflow management tools : Azkaban, Luigi, Airflow, etc.
Experience with stream-processing systems : Storm, Spark-Streaming, etc.
Experience with object-oriented / object function scripting languages : Python, Java, etc.
Knowledge of data pipelines and workflow management tools like Airflow.
#J-18808-Ljbffr
Create a job alert for this search
Data Engineer • Kuala Lumpur, Kuala Lumpur, Malaysia
Related jobs
Promoted
Senior Data Product Services Engineer
bpKuala Lumpur, Kuala Lumpur, Malaysia
Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia.Senior Data Product Services Engineer.This position requires a strategic mindset and strong technical skill, as you help drive automation, ...Show moreLast updated: 30+ days ago
Data Engineer
Two95 International Inc.Kuala Lumpur, Federal Territory of Kuala Lumpur, MY
Quick Apply
Hiring Local Malaysians only - CONTRACT JOB - 12 MONTHS (EXTENDABLE).DATA ENGINEER - IT with Extensive experience in "Healthcare ".
With Minimum Experience - 3 years & Maximun Experience - 15 ye...Show moreLast updated: 30+ days ago
Promoted
Data Engineer
Logicalis Asia PacificKuala Lumpur, Kuala Lumpur, Malaysia
Join to apply for the Data Engineer role at Logicalis Asia Pacific.Zeno was founded in 2003 to provide enterprises with custom-built technology solutions they need to keep their business running se...Show moreLast updated: 30+ days ago
Promoted
Data Engineer
Moojing Market Intelligence - 魔镜洞察Kuala Lumpur, Kuala Lumpur, Malaysia
Direct message the job poster from Moojing Market Intelligence - 魔镜洞察.Moojing Market Intelligence is an AI-empowered retail data insights provider, covering more than 100 million local and internat...Show moreLast updated: 30+ days ago
Promoted
Senior Data Engineer
Unravel CarbonKuala Lumpur, Kuala Lumpur, Malaysia
Unravel Carbon is building the agentic platform for sustainability, helping companies and consultants manage their sustainability data and make strategic decisions.
As the first AI-powered decarboni...Show moreLast updated: 25 days ago
Data Engineer - Snowflake
Oxydata SoftwareKuala Lumpur, Malaysia
Quick Apply
Greater Kuala Lumpur, Malaysia.Our client is a global leader in sustainable building materials, generating multi-billion annual revenue with operations in over 40 countries and a workforce exc...Show moreLast updated: 30+ days ago
Promoted
Senior Data Engineer
Ipsos in MalaysiaKuala Lumpur, Kuala Lumpur, Malaysia
Embark on an extraordinary career journey at Ipsos, where cutting‑edge AI work seamlessly intertwines with our day‑to‑day operations.
With a staggering global presence of 16,600 talented minds acros...Show moreLast updated: 30+ days ago
Senior Data Engineer
ZALORA SOUTH EAST ASIA PTE LTDKuala Lumpur, Kuala Lumpur, MY
Quick Apply
ZALORA Group is looking for a Senior Data Engineer to join its Data Science Team.As a Senior Data Engineer, you will : Work daily with machine learning problems.For this purpose, y...Show moreLast updated: 30+ days ago
Promoted
Azure Data Engineer
Avanade Inc.Kuala Lumpur, Kuala Lumpur, Malaysia
Utilise modern data engineering techniques with Advanced Analytics to support Avanade clients' business decisions.Design and build data pipelines, data streams, and reporting tools for insightful d...Show moreLast updated: 30+ days ago
Promoted
Data Engineer
BJAKPetaling Jaya, Selangor, Malaysia
You’ll fine-tune state-of-the-art models, design evaluation frameworks, and bring AI features into production.Your work ensures our models are not only intelligent, but also safe, trustworthy, and ...Show moreLast updated: 30+ days ago
Lead Data Engineer
QuantexaKuala Lumpur, Federal Territory of Kuala Lumpur, MY
Quick Apply
It isn’t often you get to be part of a tech company that, since 2016, has been innovating the data analytics market in ways no-one else can.
Our technology started out in FinTech, helping tackle ser...Show moreLast updated: 30+ days ago
Senior / Mid Data Engineer (ZALORA)
GLOBAL FASHION GROUP SGP SERVICES PTE LTD.Kuala Lumpur, Kuala Lumpur, MY
Quick Apply
ZALORA Group is looking for a Senior Data Engineer to join its Data Science Team.As a Senior Data Engineer, you will : Work daily with machine learning problems.For this purpose, y...Show moreLast updated: 30+ days ago
Promoted
SENIOR DATA ENGINEER
Tranglo Sdn BhdKuala Lumpur, Kuala Lumpur, Malaysia
Drive implementation and optimization of centralized data repositories and data lake architectures, supporting enterprise-wide analytics and reporting.
Identify, diagnose, and resolve data-related i...Show moreLast updated: 1 day ago
Promoted
Security Engineer – Data Leakage Prevention (DLP)
NexperiaKuala Lumpur, Kuala Lumpur, Malaysia
Security Engineer – Data Leakage Specialist (DLP) page is loaded## Security Engineer – Data Leakage Specialist (DLP)locations : Kuala Lumpurtime type : Full timeposted on : Posted Todayjob requi...Show moreLast updated: 1 day ago
Promoted
Senior Data Engineer
AverisKuala Lumpur, Kuala Lumpur, Malaysia
Senior Data Engineer page is loaded## Senior Data Engineerlocations : Kuala Lumpurtime type : Full timeposted on : Posted Todaytime left to apply : End Date : November 30, 2025 (30+ days left to...Show moreLast updated: 28 days ago
Data Engineer (Spark, SQL)
Unison GroupKuala Lumpur, Federal Territory of Kuala Lumpur, MY
Quick Apply
We are looking for a proficient Data Engineer with strong skills in Spark and SQL to join Unison Group.The successful candidate will be responsible for designing, building, and managing data pipeli...Show moreLast updated: 21 days ago
Promoted
Data Engineer
Link ComplianceKuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia
My client is one of the leading digital banks in Malaysia.Design, develop, and maintain reliable and scalable data pipelines using Apache Airflow.
Implement data ingestion, transformation, and valid...Show moreLast updated: 30+ days ago
Promoted
Senior Data Engineer
SECOND TALENT SDN. BHD.Kuala Lumpur, Kuala Lumpur, Malaysia
Google Cloud data technologies.Design, build, and maintain batch and streaming data pipelines using GCP services such as BigQuery, Dataflow, Dataproc, Composer, Dataform, and Cloud Functions.Implem...Show moreLast updated: 1 day ago
Promoted
69028 Data Engineer (ADF & Databricks)
half the skyKuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia
Avanade is the leading provider of innovative digital, cloud and advisory services, industry solutions and design-led experiences across the Microsoft ecosystem.
Every day, our 59,000 professionals ...Show moreLast updated: 30+ days ago
Senior Data Engineer
QuantexaKuala Lumpur, Federal Territory of Kuala Lumpur, MY
Quick Apply
It isn’t often you get to be part of a tech company that, since 2016, has been innovating the data analytics market in ways no-one else can.
Our technology started out in FinTech, helping tackle ser...Show moreLast updated: 30+ days ago