Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia
Data Engineer
Job Description :
My client is one of the leading digital banks in Malaysia.
Responsibilities
- Design, develop, and maintain reliable and scalable data pipelines using Apache Airflow.
- Implement data ingestion, transformation, and validation processes in Python to support :
- Loan collection tracking and reporting
- Card payment settlement workflows
- Merchant transaction analysis
- Daily / periodic balance snapshot generation
- Customer loyalty and rewards analytics
- Collaborate closely with product managers, backend engineers, and analysts to ensure data pipelines align with business requirements.
- Monitor, troubleshoot, and optimize data workflows to ensure high performance and reliability.
- Enforce data quality standards and contribute to data governance processes.
- Participate in code reviews and technical design discussions.
- (Optional) Enhance backend data services or processing logic using Java when applicable.
- Stay informed of the latest trends in data engineering to continuously improve pipeline efficiency and robustness.
Qualifications
Proven experience as a Data Engineer in a production environment.Strong expertise in Apache Airflow for workflow orchestration.Proficiency in Python for data processing tasks.Solid understanding of SQL and experience working with relational databases (e.g., PostgreSQL, MySQL).Familiarity with ETL / ELT best practices and data modeling concepts.Experience working in agile, product-focused teams.Ability to manage multiple pipelines and prioritize tasks effectively.#J-18808-Ljbffr