Talent.com
Tawaran kerja ini tidak tersedia di negara anda.
Senior Data Engineer

Senior Data Engineer

KAF GroupKuala Lumpur, Kuala Lumpur, Malaysia
1 hari lalu
Penerangan pekerjaan

Senior Manager, Group HR, Recruitment & Training

Job Summary

The Senior Data Engineer will play a critical leadership role in architecting, building, and scaling the data infrastructure that powers KAF Digital Bank’s transformation. This individual will not only design and implement robust data pipelines but also drive the overall data strategy, ensuring our systems are scalable, secure, and optimized for performance. As a senior member of the team, you will mentor junior engineers, establish best practices, and serve as a technical expert across the organization. You will be instrumental in making high-level architectural decisions and translating complex business requirements into elegant, efficient data solutions within the Azure and Snowflake ecosystems.

Key Responsibilities

  • Architect and lead the development of complex, scalable, and resilient data pipelines, integrating large volumes of structured and unstructured data.
  • Establish and enforce best practices for data engineering, including coding standards, testing frameworks, and CI / CD processes to ensure high-quality, maintainable code.
  • Evaluate and introduce new technologies, tools, and frameworks to continuously improve the data platform's capabilities and efficiency.
  • Lead the design and strategy for cloud data platforms (Azure, Snowflake), focusing on cost optimization, performance tuning, and future scalability.
  • Own the implementation of advanced data warehousing and lakehouse concepts, ensuring efficient data processing and analytics.
  • Design and manage secure and compliant data access patterns using tools like Azure API Management and other cloud-native services.
  • Own and evolve the end-to-end data architecture, from ingestion (bronze) to curated, business-ready models (gold), ensuring logical consistency and reliability.
  • Partner with security and compliance teams to implement robust data governance, data lineage, and security policies across all data platforms.
  • Develop sophisticated data models and optimize complex SQL queries to support high-performance business intelligence and data science initiatives.
  • Mentor and guide junior and mid-level data engineers, fostering a culture of technical excellence and collaborative problem-solving through code reviews and knowledge-sharing sessions.
  • Act as a go-to expert for complex technical challenges, providing guidance to team members and stakeholders.
  • Serve as a key technical advisor to Product, Finance, Operations, and other business units, translating their strategic goals into technical requirements and data-driven solutions.
  • Proactively identify opportunities where data engineering can provide significant business value, driving innovation and efficiency.

Qualifications and Requirements

Experience

  • 5-7+ years of progressive experience in data engineering, with at least 2 years in a senior or lead capacity.
  • Proven track record of designing and delivering large-scale data projects in a cloud environment, preferably within the banking or financial services industry.
  • Technical Expertise

  • Expert-level proficiency in the Azure data ecosystem (Azure Data Factory, Azure SQL, API Management, Azure Functions).
  • Mandatory expert-level proficiency and hands-on experience with Snowflake, including data modelling, performance tuning, and administration. Strong experience with Microsoft Fabric is highly advantageous.
  • Deep expertise in performance tuning for distributed systems (e.g., Spark) and advanced SQL programming.
  • Strong programming skills in Python or Scala for complex data manipulation, automation, and ETL framework development.
  • Hands-on experience implementing and managing CI / CD pipelines for data workflows (e.g., Azure DevOps, GitHub Actions).
  • Proven experience designing and implementing data lakes, data warehouses, and lakehouse architectures.
  • Other Details

  • Seniority level : Mid-Senior level
  • Employment type : Full-time
  • Job function : Information Technology
  • Industries : Financial Services and Banking
  • #J-18808-Ljbffr

    Buat amaran kerja untuk carian ini

    Senior Data Engineer • Kuala Lumpur, Kuala Lumpur, Malaysia