Data Engineer

CloudMile. Located in Federal Territory of Kuala Lumpur, Malaysia.

We are seeking an experienced Data Engineer to join our technical team. In this role, you will own our data architecture, designing and optimizing robust ETL / ELT pipelines on modern cloud platforms ( AWS , GCP , or Snowflake ). Your work will bridge raw data and actionable insights, ensuring scalable, cost‑effective, and fault‑tolerant infrastructure.

Key Responsibilities

• Advanced Pipeline Development : Design, build, and maintain scalable ETL / ELT pipelines using SQL and Python , moving data from APIs, databases, and logs into the Data Warehouse.
• Cloud Architecture & Management : Manage and optimize cloud infrastructure on AWS (Redshift, Glue, Lambda, S3), GCP (BigQuery, Dataflow, Cloud Composer), or Snowflake ; configure access and storage.
• Performance Tuning & Cost Optimization : Monitor query performance, refactor inefficient code, and implement cost‑saving strategies.
• Data Modeling : Build efficient star / snowflake schemas and semantic layers that serve as the company’s single source of truth.
• BI Infrastructure & Semantic Layer : Serve visualization tools ( Tableau , Power BI , Looker , AWS QuickSight ), defining reusable models (LookML or Power BI datasets).
• Orchestration & Automation : Build workflow orchestrations with Apache Airflow , AWS Glue, or similar; implement CI / CD for data pipelines.
• Data Quality & Governance : Enforce quality standards and create automated tests (Great Expectations, dbt tests) to detect anomalies.
• End‑to‑End Dashboard Development : Own the “last mile” of data delivery : gather stakeholder requirements, design layouts, and build dashboards.

Requirements

AWS : Redshift, EMR, Glue, Lambda, S3.

Preferred Qualifications (Nice to have)

Additional Information

#J-18808-Ljbffr