Senior Data Engineer

Data Management : Develop, monitor, and maintain ETL (Extract, Transform, Load) processes to ensure data is accurately and efficiently loaded into data warehouses or data mart

Work with BI Architects to design logical and physical analytical data models.

Provide day-to-day support for BI and Data Management solutions

Create and maintain data dictionaries and data lineage. Resolve data quality issues and establish data integrity checks.

Performance Tuning : Optimize ETL performance to ensure efficient data processing and reporting.

Must-have

• Bachelor's degree or above in Computer Science, Statistics, Mathematics, or a related STEM field.
• 3+ years of big data development experience, handling terabyte-scale datasets.
• Strong English communication skills in all areas (reading, writing, speaking, and listening).
• Proficient in the Python programming language and common frameworks, with extensive experience using libraries such as NumPy, Pandas, scikit-learn, and Matplotlib / Plotly.
• Solid understanding of core big data ETL / ELT processes and data layering concepts, with hands-on experience in designing and building ETL / ELT pipelines.
• Highly skilled in developing and deploying solutions with Apache Airflow and SparkSQL.
• Familiar with data warehouses (e.g., AWS Redshift, Snowflake) and have development / configuration experience with services / tools such as AWS Glue, Step Functions, Athena, Databricks, or dbt.
• Mastery of at least one relational database like MySQL or PostgreSQL, with strong SQL scripting and performance tuning skills.
• Proficient in using Git for version control, with a commitment to writing clean, well-documented code.

Nice-to-have

Additional Preferred Qualifications

Worldline International (Malaysia) Sdn Bhd

#J-18808-Ljbffr