Talent.com
Data Resiliency Engineer - Data Lake

Data Resiliency Engineer - Data Lake

Fairview International SchoolMalaysia, Malaysia
30+ days ago
Job description

As a Data Resiliency Engineer, you will be at the forefront of maintaining and enhancing the robustness of our data infrastructure. You will analyze issues to identify root causes and implement solutions that ensure a seamless user experience. Your expertise in data ecosystem monitoring, incident management, and data quality enhancement will play a pivotal role in maintaining operational excellence. You will utilize advanced tools like Datadog and Opsgenie to proactively monitor and resolve issues, act as a subject matter expert for data-related inquiries, and champion data quality initiatives. Additionally, you will work closely with the team to ensure our suite of payments reporting systems for participants as well as PayNet internal reports, are accurate and aligned with evolving organizational needs, driving continuous improvement in our data-driven operations.

KEY AREAS OF RESPONSIBILITIES

  • Root Cause Analysis & Bug Fixing : Analyze issues to uncover root causes and implement effective solutions, ensuring a smooth user experience.
  • Data Ecosystem Monitoring : Oversee the data environment using advanced monitoring tools like Datadog, proactively identifying and addressing issues before they escalate.
  • Alert System Management : Collaborate with the team managing Opsgenie and other alert systems, ensuring timely responses to critical incidents and maintaining operational excellence.
  • Data Lake Support : Serve as the primary contact for data-related inquiries, including ETL incident management, reporting challenges, and providing actionable insights.
  • Data Quality Monitoring : Own and enhance data quality monitoring tools, designing robust pipelines and frameworks to maintain the highest data integrity standards.
  • Reporting Management : Lead report amendments and ensure reporting processes are accurate and meet the evolving needs of the organization.

QUALIFICATIONS & EXPERIENCE

Minimum Qualifications

  • Bachelor's degree in Computer Science, Engineering, Information Systems, or a related field.
  • Strong experience with AWS data services (e.g., S3, Glue, Athena, Quicksight, Lambda).
  • Strong experience in Python programming language
  • Proficiency in PySpark for large-scale data processing.
  • Familiarity with workflow management tools (e.g., Apache Airflow)
  • Familiarity with operating data tools on Kubernetes and EKS
  • Expertise in monitoring tools (e.g., Datadog, CloudWatch) to proactively track and resolve issues.
  • Experience with alert management systems like Opsgenie or similar platforms.
  • Strong understanding of data lakes and managing large-scale data environments.
  • Experience in performing root cause analysis for complex data issues and implementing effective bug fixes.
  • Terraform or other IaC tools for infrastructure provisioning
  • Relevant certifications in AWS and data engineering
  • PERSONAL QUALITIES

  • Self-motivated problem solver who can work with minimal guidance
  • Excellent communication skills to articulate technical details clearly to non-technical stakeholders.
  • Detail-oriented with a focus on data quality and reliability
  • Proven ability to work cross-functionally with multiple teams (e.g., Data Engineering, Operations, Analytics).
  • Passionate engineer looking to learn new technologies
  • Embark on an exciting career journey with Payments Network Malaysia Sdn Bhd (PayNet), the heartbeat of Malaysia's financial markets!

    As the national payments network and a pivotal infrastructure for Malaysia’s dynamic financial markets, PayNet is a linchpin in advancing the nation’s digital economy.

    Our comprehensive suite of retail payment solutions - encompassing DuitNow (QR and P2P), JomPAY (Bill Payments), FPX (Online), MyDebit (Domestic Debit), MEPS (ATM), and IBG (Interbank GIRO) - not only offer wide accessibility but are seamlessly integrated into the fabric of daily life in Malaysia. These services have revolutionised the way Malaysians handle financial transactions, marking a significant leap in consumer convenience and efficiency.

    At PayNet, our focus is on providing a safe, efficient, and innovative payments system. We are dedicated to improving and managing payment services that meet the evolving needs of consumers and businesses. Our work ensures the stability and reliability of Malaysia’s financial system, supporting the growth of the economy.

    Learn more about our work and how we are contributing to Malaysia's financial future at

    Join us in embracing digital payments and advancing Malaysia's financial landscape.

    #J-18808-Ljbffr

    Create a job alert for this search

    Data Engineer • Malaysia, Malaysia

    Related jobs
    • Promoted
    Cloud Resiliency Engineer(Mandarin Speaker)

    Cloud Resiliency Engineer(Mandarin Speaker)

    ConcentrixMalaysia, Malaysia
    Cloud Engineer will support customers through focused technical engagements aimed at improving the reliability, continuity, and recoverability of their cloud environments.The architect will combine...Show moreLast updated: 12 days ago
    • Promoted
    Data Engineer

    Data Engineer

    WhiteCoatMalaysia, Malaysia
    WhiteCoat is a Singapore-headquartered omnichannel provider of integrated health and wellness services that serves as the first and single touchpoint for all care needs in Southeast Asia.Since laun...Show moreLast updated: 24 days ago
    • Promoted
    Data Engineering Analyst

    Data Engineering Analyst

    Brooks Automation, Inc.Malaysia, Malaysia
    Data Engineer page is loaded## Data Engineerlocations : Malaysia - Johortime type : Full timeposted on : Posted 3 Days Agojob requisition id : R4836Brooks is a leading provider of automation so...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Monroe Consulting GroupMalaysia, Malaysia
    Monroe Consulting Group's Technology Division.Government-Linked Company (GLC).Our client is recognised for driving transformative initiatives, embracing innovation, and delivering long-term value t...Show moreLast updated: 24 days ago
    • Promoted
    Technical Leader - PreFab Data Center

    Technical Leader - PreFab Data Center

    Schneider ElectricMalaysia, Malaysia
    In Schneider Electric, everything we do is geared towards advancing progress and sustainability for all—our colleagues, customers, partners, and the communities and societies we serve.Whether it's ...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer / Senior Data Engineer

    Data Engineer / Senior Data Engineer

    MoneyHero Group (Nasdaq : MNY)Malaysia, Malaysia
    Data Engineer / Senior Data Engineer.Get AI-powered advice on this job and more exclusive features.This is a fully remote role to be based in Malaysia. We will prioritize candidates who are based in ...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Fairview International SchoolMalaysia, Malaysia
    We are a digital health therapeutics company operating across SEA, focused on the intersection of mental health and physical chronic diseases. We combine behavioral science, psychology, data science...Show moreLast updated: 30+ days ago
    • Promoted
    DevOps Engineer - Data Lake

    DevOps Engineer - Data Lake

    Fairview International SchoolMalaysia, Malaysia
    As a Principal DevOps Engineer supporting DataOps, you will play a crucial role in enabling efficient and reliable data pipeline building, data analysis, and data governance.Your primary responsibi...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Process Safety Engineer

    Senior Process Safety Engineer

    FLEXSYSPahangMalaysia, Pahang, Malaysia
    The Process Safety Engineer will provide Process Safety services and support Southern Asia.Most of the support will be for the Flexsys Kuantan Malaysia site where the engineer’s office will be loca...Show moreLast updated: 30+ days ago
    • Promoted
    Big Data Engineer

    Big Data Engineer

    Shirlyn TechnologyMalaysia, Malaysia
    We are looking for a full-time Big Data Engineer II to join our team at Shirlyn Technology in Petaling Jaya, Malaysia and Palo Alto, California. The Big Data team is at the heart of our operations, ...Show moreLast updated: 30+ days ago
    • Promoted
    SRC Analyst

    SRC Analyst

    Fairview International SchoolMalaysia, Malaysia
    The SRC Analyst specializes in IT processes and workflows for IT Operations, focusing on integration with other departments. They are responsible for identifying opportunities to improve, reduce pro...Show moreLast updated: 30+ days ago
    • Promoted
    Digital Engineer

    Digital Engineer

    JACOBS DOUWE EGBERTSMalaysia, Malaysia
    The Digital Engineer builds data capabilities to enable development and scaling of digital use cases.Responsibilities / Key Activities : . Implement, maintain, and improve the OT Data Foundation acros...Show moreLast updated: 30+ days ago
    • Promoted
    Geophysicist

    Geophysicist

    OUS GroupPahangMalaysia, Pahang, Malaysia
    At OUS Group, we’re driven by discovery.As a growing force in Malaysia’s iron ore mining industry, we’re seeking a.This is a field-based role that will take you across Malaysia—from remote explorat...Show moreLast updated: 26 days ago
    • Promoted
    Software Engineer, Data Infrastructure & Acquisition - Asia

    Software Engineer, Data Infrastructure & Acquisition - Asia

    SpeechifyMalaysia, Malaysia
    Speechify is a text-to-speech app that makes it easy for the world to access information.Google Chrome extension, web app, iOS app, and Android app. Our mission is to make sure that reading is never...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Associate, Sustainability & Climate Strategy, Policy and Data Management

    Senior Associate, Sustainability & Climate Strategy, Policy and Data Management

    RHB BankMalaysia, Malaysia
    We are seeking a highly motivated.Group Sustainability team at RHB Banking Group.In this role, you will support the execution of the Group’s Sustainability and Climate Strategy with a strong emphas...Show moreLast updated: 24 days ago
    • Promoted
    MLOps Engineer

    MLOps Engineer

    ROCKWOOL International A / SMalaysia, Malaysia
    Ready to help build a better future for generations to come?.In an ever-changing, fast-paced world, we owe it to ourselves and our future generations to live life responsibly.At ROCKWOOL, we work r...Show moreLast updated: 30+ days ago
    • Promoted
    Digital Engineer APAC

    Digital Engineer APAC

    JdeprofessionalMalaysia, Malaysia
    The Digital Engineer builds data capabilities to enable development and scaling of digital use cases.Responsibilities / Key Activities : . Implement, maintain, and improve the OT Data Foundation acros...Show moreLast updated: 30+ days ago
    • Promoted
    AI Data Analyst

    AI Data Analyst

    Brooks Automation, Inc.Malaysia, Malaysia
    AI Data Analyst## • •Job Description • • • •About Brooks : • •Brooks is a leading provider of automation solutions with over 40 years of experience in the semiconductor industry, offering precision robotic...Show moreLast updated: 30+ days ago