Talent.com
This job offer is not available in your country.
Data Engineer

Data Engineer

DATABRICKS TECH SDN. BHD.Kuala Lumpur, Kuala Lumpur, Malaysia
16 hours ago
Job description

Job Purpose

We are seeking a skilled Data Engineer to manage, secure, and transform data from various systems into our data warehouse. The ideal candidate will facilitate data integration, ensure accuracy, and provide valuable datasets and reports tailored to business needs.

Key Responsibilities

  • Maintain, back up, and secure data from multiple systems into the data warehouse.
  • Integrate data with internal and third-party systems
  • Build and maintain datasets for downstream consumptions
  • Implement data validation, documentation, and monitoring to ensure high-quality and trustworthy datasets
  • Validate and ensure the accuracy of all data
  • Promote data engineering best practices, automation, and continuous improvement across projects and teams
  • Deliver reports and updates to meet stakeholder requirements through analytics
  • Perform other ad hoc tasks as needed.

Qualifications

Required : Experience :

Minimum of 2 years of experience in any major RDBMS, preferably :

PostgreSQL

  • MySQL
  • MSSQL
  • At least 1 year of experience with cloud data warehouses, preferably Google BigQuery.
  • For data engineers : 1-3 years of experience in similar roles and responsibilities. Fresh graduates with strong technical acumen are welcomed to apply
  • For senior data engineers : 3-7 years of experience in similar roles and responsibilities

    • Technical Skills :

    Proficient in writing and debugging complex SQL queries.

  • Strong understanding of partitioning, clustering, and indexing.
  • Experience with ETL tools such as Pentaho, Apache Nifi, or similar.
  • Strong analytical skills and attention to detail.
  • Excellent communication skills.

    • Nice to Have :

  • Experience in Python programming.
  • Familiarity with tools like Apache Airflow, dbt (Data Build Tools), or Kafka.
  • Advanced knowledge of data analytics and management.
  • Proficiency in optimizing queries in BigQuery.
  • Deep understanding of Google Cloud Platform (GCP) infrastructure and APIs.
  • Background in OData Service administration.
  • Exposure to ML / AI workloads is a plus, but not required
  • Bonus : Experience working with streaming / event-driven architectures and feature stores

    • Why Join Us?

  • Work on a wide range of real-world data projects, from traditional BI to modern data application
  • Shape cutting-edge LLM and AI initiatives by bridging data engineering and model development
  • Work in a collaborative and supportive environment that values learning, professional growth, and strong interpersonal connections
  • Benefit from a hybrid work arrangement, offering flexibility to balance your professional and personal life
    • Create a job alert for this search

    Data Engineer • Kuala Lumpur, Kuala Lumpur, Malaysia