Wasco WP. Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia
Direct message the job poster from Wasco
Human Resources Manager at Wasco Energy Group of Companies
Purpose of the Role :
IT&D department is now embarking on a journey of internal transformation, where IT strategies, targets, processes, platforms, vendors and employee skillsets need to be revised and modernized in order to align with Wasco's latest business needs and goals. This role is responsible to design, build and maintain scalable and efficient data pipelines and platforms to support analytics and Al in ensuring data is accessible, clean, secure and reliable.
Job scope :
- Data architecture and modelling - define and evolve data architecture and models for both structured and unstructured data, as well as loT real-time data streaming.
- Data pipeline development - design, build and manage ETL / ELT pipelines including automated data ingestion from multiple sources and optimized workflow for greater speed, performance and scalability.
- Data governance - establish, enforce and execute data governance framework and procedures for data quality checks, validation rules and monitoring.
- Mentorship and people management - Manage and guide other data engineer(s), collabo rate closely with Digital Business Analyst, Enterprise Application Lead, Project Manager and Digital Acceleration Manager.
Requirements :
Bachelor’s degree in computer science, Information Technology, Engineering, Mathematics, or a related field.3-5 years of experience in data engineering or related rolesKnowledge / Skills :
Strong coding in Python and SQL.Deep experience with ETL / ELT tools, e.g. dbt, Airbytes etc.Proficient with cloud data and app services of GCP, AWS and / or Azure.Solid understanding of Data Warehouse for both structured and unstructured data, real-time data streaming and also Cl / CD of data workflows.Strong problem-solving and analytical thinking.Effective communication with team members, external vendors and non-technical stakeholders.Good understanding of how Al / GenAI worksFamiliarity with Lambda Architecture for handling both batch and real-time (event-driven) data processingExperience with Medallion Architecture (Bronze, Silver, Gold layers) for building scalable and structured data lakes / lakehouses.Expertise in Dimensional Modelling (e.g., star and snowflake schemas) to support Bl and analytics use cases.Proficient with real-time data streaming platforms, such as Apache Kafka, Spark Streaming, or Google Pub / Sub.Experience with data orchestration tools such as Apache Airflow, Prefect, or Dagster for building and managing data workflowSeniority level
Mid-Senior level
Employment type
Full-time
Job function
Information Technology
Industries
Oil and Gas
Referrals increase your chances of interviewing at Wasco by 2x
Get notified about new Data Engineer jobs in WP. Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia .
#J-18808-Ljbffr