Talent.com
This job offer is not available in your country.
Data Engineer

Data Engineer

Moving Walls GroupKuala Lumpur, Kuala Lumpur, Malaysia
30+ days ago
Job description

Responsibilities

  • Create and maintain the optimal data pipeline architecture.
  • Assemble large, complex data sets that meet functional / non-functional business requirements.
  • Identify, design, and implement internal process improvements : automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
  • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS ‘big data’ technologies.
  • Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics.
  • Work with stakeholders including the Executive, Product, Data, and Design teams to assist with data-related technical issues and support their data infrastructure needs.
  • Keep our data separated and secure across national boundaries through multiple data centers and AWS regions.
  • Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
  • Work with data and analytics experts to strive for greater functionality in our data systems.

Qualifications for Data Engineer

  • We are looking for a candidate with 5+ years of experience in a Data Engineer role, who has attained a Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field. They should also have experience using the following software / tools :
  • Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
  • Experience building and optimizing ‘big data’ data pipelines, architectures, and data sets.
  • Experience performing root cause analysis of internal and external data and processes to answer specific business questions and identify opportunities for improvement.
  • Strong analytic skills related to working with unstructured data sets.
  • Build processes supporting data transformation, data structures, metadata, dependency, and workload management.
  • A successful history of manipulating, processing, and extracting value from large disconnected datasets.
  • Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.
  • Strong project management and organizational skills.
  • Experience supporting and working with cross-functional teams in a dynamic environment.
  • Experience with big data tools : Hadoop, Spark, Kafka, etc.
  • Experience with relational SQL and NoSQL databases, including MongoDB, Postgres, and Cassandra, AWS Redshift, Snowflake.
  • Experience with data pipeline and workflow management tools : Azkaban, Luigi, Airflow, etc.
  • Experience with AWS cloud services : EC2, EMR, ETL, Glue, RDS, Redshift.
  • Experience with stream-processing systems : Storm, Spark-Streaming, etc.
  • Experience with object-oriented / object function scripting languages : Python, Java, etc.
  • Knowledge of data pipelines and workflow management tools like Airflow.
  • #J-18808-Ljbffr

    Create a job alert for this search

    Data Engineer • Kuala Lumpur, Kuala Lumpur, Malaysia

    Related jobs
    • Promoted
    Senior Data Product Services Engineer

    Senior Data Product Services Engineer

    bpKuala Lumpur, Kuala Lumpur, Malaysia
    Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia.Senior Data Product Services Engineer.This position requires a strategic mindset and strong technical skill, as you help drive automation, ...Show moreLast updated: 30+ days ago
    Data Engineer

    Data Engineer

    Two95 International Inc.Kuala Lumpur, Federal Territory of Kuala Lumpur, MY
    Quick Apply
    Hiring Local Malaysians only - CONTRACT JOB - 12 MONTHS (EXTENDABLE).DATA ENGINEER - IT with Extensive experience in "Healthcare ". With Minimum Experience - 3 years & Maximun Experience - 15 ye...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Logicalis Asia PacificKuala Lumpur, Kuala Lumpur, Malaysia
    Join to apply for the Data Engineer role at Logicalis Asia Pacific.Zeno was founded in 2003 to provide enterprises with custom-built technology solutions they need to keep their business running se...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Moojing Market Intelligence - 魔镜洞察Kuala Lumpur, Kuala Lumpur, Malaysia
    Direct message the job poster from Moojing Market Intelligence - 魔镜洞察.Moojing Market Intelligence is an AI-empowered retail data insights provider, covering more than 100 million local and internat...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Unravel CarbonKuala Lumpur, Kuala Lumpur, Malaysia
    Unravel Carbon is building the agentic platform for sustainability, helping companies and consultants manage their sustainability data and make strategic decisions. As the first AI-powered decarboni...Show moreLast updated: 25 days ago
    Data Engineer - Snowflake

    Data Engineer - Snowflake

    Oxydata SoftwareKuala Lumpur, Malaysia
    Quick Apply
    Greater Kuala Lumpur, Malaysia.Our client is a global leader in sustainable building materials, generating multi-billion annual revenue with operations in over 40 countries and a workforce exc...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Ipsos in MalaysiaKuala Lumpur, Kuala Lumpur, Malaysia
    Embark on an extraordinary career journey at Ipsos, where cutting‑edge AI work seamlessly intertwines with our day‑to‑day operations. With a staggering global presence of 16,600 talented minds acros...Show moreLast updated: 30+ days ago
    Senior Data Engineer

    Senior Data Engineer

    ZALORA SOUTH EAST ASIA PTE LTDKuala Lumpur, Kuala Lumpur, MY
    Quick Apply
    ZALORA Group is looking for a Senior Data Engineer to join its Data Science Team.As a Senior Data Engineer, you will : Work daily with machine learning problems.For this purpose, y...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Avanade Inc.Kuala Lumpur, Kuala Lumpur, Malaysia
    Utilise modern data engineering techniques with Advanced Analytics to support Avanade clients' business decisions.Design and build data pipelines, data streams, and reporting tools for insightful d...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    BJAKPetaling Jaya, Selangor, Malaysia
    You’ll fine-tune state-of-the-art models, design evaluation frameworks, and bring AI features into production.Your work ensures our models are not only intelligent, but also safe, trustworthy, and ...Show moreLast updated: 30+ days ago
    Lead Data Engineer

    Lead Data Engineer

    QuantexaKuala Lumpur, Federal Territory of Kuala Lumpur, MY
    Quick Apply
    It isn’t often you get to be part of a tech company that, since 2016, has been innovating the data analytics market in ways no-one else can. Our technology started out in FinTech, helping tackle ser...Show moreLast updated: 30+ days ago
    Senior / Mid Data Engineer (ZALORA)

    Senior / Mid Data Engineer (ZALORA)

    GLOBAL FASHION GROUP SGP SERVICES PTE LTD.Kuala Lumpur, Kuala Lumpur, MY
    Quick Apply
    ZALORA Group is looking for a Senior Data Engineer to join its Data Science Team.As a Senior Data Engineer, you will : Work daily with machine learning problems.For this purpose, y...Show moreLast updated: 30+ days ago
    • Promoted
    SENIOR DATA ENGINEER

    SENIOR DATA ENGINEER

    Tranglo Sdn BhdKuala Lumpur, Kuala Lumpur, Malaysia
    Drive implementation and optimization of centralized data repositories and data lake architectures, supporting enterprise-wide analytics and reporting. Identify, diagnose, and resolve data-related i...Show moreLast updated: 1 day ago
    • Promoted
    Security Engineer – Data Leakage Prevention (DLP)

    Security Engineer – Data Leakage Prevention (DLP)

    NexperiaKuala Lumpur, Kuala Lumpur, Malaysia
    Security Engineer – Data Leakage Specialist (DLP) page is loaded## Security Engineer – Data Leakage Specialist (DLP)locations : Kuala Lumpurtime type : Full timeposted on : Posted Todayjob requi...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    AverisKuala Lumpur, Kuala Lumpur, Malaysia
    Senior Data Engineer page is loaded## Senior Data Engineerlocations : Kuala Lumpurtime type : Full timeposted on : Posted Todaytime left to apply : End Date : November 30, 2025 (30+ days left to...Show moreLast updated: 28 days ago
    Data Engineer (Spark, SQL)

    Data Engineer (Spark, SQL)

    Unison GroupKuala Lumpur, Federal Territory of Kuala Lumpur, MY
    Quick Apply
    We are looking for a proficient Data Engineer with strong skills in Spark and SQL to join Unison Group.The successful candidate will be responsible for designing, building, and managing data pipeli...Show moreLast updated: 21 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Link ComplianceKuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia
    My client is one of the leading digital banks in Malaysia.Design, develop, and maintain reliable and scalable data pipelines using Apache Airflow. Implement data ingestion, transformation, and valid...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SECOND TALENT SDN. BHD.Kuala Lumpur, Kuala Lumpur, Malaysia
    Google Cloud data technologies.Design, build, and maintain batch and streaming data pipelines using GCP services such as BigQuery, Dataflow, Dataproc, Composer, Dataform, and Cloud Functions.Implem...Show moreLast updated: 1 day ago
    • Promoted
    69028 Data Engineer (ADF & Databricks)

    69028 Data Engineer (ADF & Databricks)

    half the skyKuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia
    Avanade is the leading provider of innovative digital, cloud and advisory services, industry solutions and design-led experiences across the Microsoft ecosystem. Every day, our 59,000 professionals ...Show moreLast updated: 30+ days ago
    Senior Data Engineer

    Senior Data Engineer

    QuantexaKuala Lumpur, Federal Territory of Kuala Lumpur, MY
    Quick Apply
    It isn’t often you get to be part of a tech company that, since 2016, has been innovating the data analytics market in ways no-one else can. Our technology started out in FinTech, helping tackle ser...Show moreLast updated: 30+ days ago