Talent.com
Data Resiliency Engineer - Data Lake
Data Resiliency Engineer - Data LakeFairview International School • Malaysia, Malaysia
Data Resiliency Engineer - Data Lake

Data Resiliency Engineer - Data Lake

Fairview International School • Malaysia, Malaysia
30+ days ago
Job description

As a Data Resiliency Engineer, you will be at the forefront of maintaining and enhancing the robustness of our data infrastructure. You will analyze issues to identify root causes and implement solutions that ensure a seamless user experience. Your expertise in data ecosystem monitoring, incident management, and data quality enhancement will play a pivotal role in maintaining operational excellence. You will utilize advanced tools like Datadog and Opsgenie to proactively monitor and resolve issues, act as a subject matter expert for data-related inquiries, and champion data quality initiatives. Additionally, you will work closely with the team to ensure our suite of payments reporting systems for participants as well as PayNet internal reports, are accurate and aligned with evolving organizational needs, driving continuous improvement in our data-driven operations.

KEY AREAS OF RESPONSIBILITIES

  • Root Cause Analysis & Bug Fixing : Analyze issues to uncover root causes and implement effective solutions, ensuring a smooth user experience.
  • Data Ecosystem Monitoring : Oversee the data environment using advanced monitoring tools like Datadog, proactively identifying and addressing issues before they escalate.
  • Alert System Management : Collaborate with the team managing Opsgenie and other alert systems, ensuring timely responses to critical incidents and maintaining operational excellence.
  • Data Lake Support : Serve as the primary contact for data-related inquiries, including ETL incident management, reporting challenges, and providing actionable insights.
  • Data Quality Monitoring : Own and enhance data quality monitoring tools, designing robust pipelines and frameworks to maintain the highest data integrity standards.
  • Reporting Management : Lead report amendments and ensure reporting processes are accurate and meet the evolving needs of the organization.

QUALIFICATIONS & EXPERIENCE

Minimum Qualifications

  • Bachelor's degree in Computer Science, Engineering, Information Systems, or a related field.
  • Strong experience with AWS data services (e.g., S3, Glue, Athena, Quicksight, Lambda).
  • Strong experience in Python programming language
  • Proficiency in PySpark for large-scale data processing.
  • Familiarity with workflow management tools (e.g., Apache Airflow)
  • Familiarity with operating data tools on Kubernetes and EKS
  • Expertise in monitoring tools (e.g., Datadog, CloudWatch) to proactively track and resolve issues.
  • Experience with alert management systems like Opsgenie or similar platforms.
  • Strong understanding of data lakes and managing large-scale data environments.
  • Experience in performing root cause analysis for complex data issues and implementing effective bug fixes.
  • Terraform or other IaC tools for infrastructure provisioning
  • Relevant certifications in AWS and data engineering
  • PERSONAL QUALITIES

  • Self-motivated problem solver who can work with minimal guidance
  • Excellent communication skills to articulate technical details clearly to non-technical stakeholders.
  • Detail-oriented with a focus on data quality and reliability
  • Proven ability to work cross-functionally with multiple teams (e.g., Data Engineering, Operations, Analytics).
  • Passionate engineer looking to learn new technologies
  • Embark on an exciting career journey with Payments Network Malaysia Sdn Bhd (PayNet), the heartbeat of Malaysia's financial markets!

    As the national payments network and a pivotal infrastructure for Malaysia’s dynamic financial markets, PayNet is a linchpin in advancing the nation’s digital economy.

    Our comprehensive suite of retail payment solutions - encompassing DuitNow (QR and P2P), JomPAY (Bill Payments), FPX (Online), MyDebit (Domestic Debit), MEPS (ATM), and IBG (Interbank GIRO) - not only offer wide accessibility but are seamlessly integrated into the fabric of daily life in Malaysia. These services have revolutionised the way Malaysians handle financial transactions, marking a significant leap in consumer convenience and efficiency.

    At PayNet, our focus is on providing a safe, efficient, and innovative payments system. We are dedicated to improving and managing payment services that meet the evolving needs of consumers and businesses. Our work ensures the stability and reliability of Malaysia’s financial system, supporting the growth of the economy.

    Learn more about our work and how we are contributing to Malaysia's financial future at

    Join us in embracing digital payments and advancing Malaysia's financial landscape.

    #J-18808-Ljbffr

    Create a job alert for this search

    Data Engineer • Malaysia, Malaysia

    Related jobs
    Data Engineer

    Data Engineer

    WhiteCoat • Malaysia, Malaysia
    WhiteCoat is a Singapore-headquartered omnichannel provider of integrated health and wellness services that serves as the first and single touchpoint for all care needs in Southeast Asia.Since laun...Show more
    Last updated: 30+ days ago • Promoted
    Multilingual LLM Data Evaluator (Bahasa Melayu and English)

    Multilingual LLM Data Evaluator (Bahasa Melayu and English)

    Chemin AI • Malaysia, Malaysia
    Multilingual LLM Data Evaluator (Bahasa Melayu and English).Chemin is partnering with a well‑established enterprise with an innovation arm focused on emerging technologies, infrastructure, and AI‑r...Show more
    Last updated: 6 days ago • Promoted
    Manager, Cyber Resilience Testing

    Manager, Cyber Resilience Testing

    Bank Islam • Malaysia, Malaysia
    As the Manager, Cyber Resilience Testing (CRT) Operations, you will be responsible for leading the strategic planning, execution, and continuous improvement of advanced cyber resilience testing, re...Show more
    Last updated: 20 days ago • Promoted
    Cloud Resiliency Engineer (Mandarin Speaker)

    Cloud Resiliency Engineer (Mandarin Speaker)

    Concentrix • Malaysia, Malaysia
    The intelligent transformation partner.The global technology and services leader that powers the world’s best brands, today and into the future. We’re solution-focused, tech-powered, intelligence-fu...Show more
    Last updated: 30+ days ago • Promoted
    Technical Leader - PreFab Data Center

    Technical Leader - PreFab Data Center

    Schneider Electric • Malaysia, Malaysia
    In Schneider Electric, everything we do is geared towards advancing progress and sustainability for all—our colleagues, customers, partners, and the communities and societies we serve.Whether it's ...Show more
    Last updated: 30+ days ago • Promoted
    Platform Reliability Engineer (Tanzu)

    Platform Reliability Engineer (Tanzu)

    Confidential • Malaysia
    Please find the Skill set requirement for Tanzu (TAS & TKGi).Tanzu Application Service (TAS), BOSH, Ops Manager, CF Cli.Different types of Tiles using Tanzu platform (Bosh director, antivirus, harb...Show more
    Last updated: 18 days ago • Promoted
    Senior Software Engineer, Data Platform

    Senior Software Engineer, Data Platform

    CoinGecko • Malaysia, Malaysia
    Senior Software Engineer, Data Platform.We practice transparent salaries and a level structure at CoinGecko.The salary for this position is RM 16,407. Learn more about our level structure at CoinGec...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Fairview International School • Malaysia, Malaysia
    We are a digital health therapeutics company operating across SEA, focused on the intersection of mental health and physical chronic diseases. We combine behavioral science, psychology, data science...Show more
    Last updated: 30+ days ago • Promoted
    DevOps Engineer - Data Lake

    DevOps Engineer - Data Lake

    Fairview International School • Malaysia, Malaysia
    As a Principal DevOps Engineer supporting DataOps, you will play a crucial role in enabling efficient and reliable data pipeline building, data analysis, and data governance.Your primary responsibi...Show more
    Last updated: 30+ days ago • Promoted
    Big Data Engineer

    Big Data Engineer

    Shirlyn Technology • Malaysia, Malaysia
    We are looking for a full-time Big Data Engineer II to join our team at Shirlyn Technology in Petaling Jaya, Malaysia and Palo Alto, California. The Big Data team is at the heart of our operations, ...Show more
    Last updated: 30+ days ago • Promoted
    Azure Cloud Resiliency Architect | DR, MIRP & SRE Lead

    Azure Cloud Resiliency Architect | DR, MIRP & SRE Lead

    Concentrix • Malaysia, Malaysia
    A global technology and services leader in Malaysia is seeking a Cloud Architect to enhance the reliability and recoverability of cloud environments. This mid-senior level position requires expertis...Show more
    Last updated: 6 days ago • Promoted
    Senior Architect (Business Intelligence / Data Analytics)

    Senior Architect (Business Intelligence / Data Analytics)

    DHL Germany • Malaysia, Malaysia
    Senior Architect (BI / Data Analytics).With a global team of 6000+ IT professionals, DHL IT Services.Our offices in Cyberjaya, Prague, and Chennai have earned. At IT Services, we are passionate about ...Show more
    Last updated: 22 days ago • Promoted
    Cloud Resiliency Engineer

    Cloud Resiliency Engineer

    GSS-PH Consulting Solution Inc. • Malaysia, Malaysia
    Senior Manager Recruitment & Client Management @ Confidential.Work Location : Malaysia (for Mandarin speaker).Mode of Work (Onsite / Hybrid / Remote) : Remote. Expats can be considered, but language asses...Show more
    Last updated: 5 days ago • Promoted
    Data Modeler

    Data Modeler

    Confidential • Malaysia
    Hiring : Data Modeler / Solution Designer (3+ Years) – Malaysia (Onsite).We are looking for a Data Modeler / Solution Designer with strong cloud, data modelling, and BI experience.Cloud Architecture...Show more
    Last updated: 30+ days ago • Promoted
    AWS Cloud Engineer

    AWS Cloud Engineer

    Confidential • Malaysia
    Position : AWS Cloud Consultant.Type : Contract / Full-time (Customize).We are looking for an experienced AWS Cloud Consultant to provide guidance, support, and best practices across cloud operations...Show more
    Last updated: 8 days ago • Promoted
    MLOps Engineer

    MLOps Engineer

    ROCKWOOL International A / S • Malaysia, Malaysia
    Ready to help build a better future for generations to come?.In an ever-changing, fast-paced world, we owe it to ourselves and our future generations to live life responsibly.At ROCKWOOL, we work r...Show more
    Last updated: 30+ days ago • Promoted
    Machine Learning Engineer

    Machine Learning Engineer

    Second Talent • Malaysia, Malaysia
    Member of Technical Staff - Environments (ML).As an Environment Engineer (ML), you will build on top of our core platform to create the simulation environments in which frontier coding agents learn...Show more
    Last updated: 19 days ago • Promoted
    MS Fabric Solutions Architect : AI-Ready Data Platform

    MS Fabric Solutions Architect : AI-Ready Data Platform

    Sentinel • Malaysia, Malaysia
    A global provider of construction tools is seeking an MS Fabric Solutions Architect to design and operate the data layer for their internal Sales application. This role involves architecting data in...Show more
    Last updated: 4 days ago • Promoted