Talent.com
This job offer is not available in your country.
Staff Data Lake Platform Engineering Lead

Staff Data Lake Platform Engineering Lead

bpKuala Lumpur, Kuala Lumpur, Malaysia
1 day ago
Job description

Staff Data Lake Platform Engineering Lead

bp Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia

Overview

At bp, our purpose is to deliver energy for today and tomorrow. For over a century, we’ve been discovering, developing, and producing energy across the globe. We are one of the few companies capable of offering a fully integrated energy solution to governments and customers. Sustainability and responsibility are at the heart of our strategy as we aim to become a net zero company by 2050 or sooner.

Key Responsibilities

  • Lead the architecture, security, and platform engineering for our core data platform, ensuring alignment with enterprise technology goals.
  • Oversee the end-to-end security of our unified data platform, ensuring compliance with industry regulations and standards.
  • Drive operational excellence across enterprise systems, optimizing for performance, availability, and scalability.
  • Spearhead modernization and transformation initiatives, ensuring seamless integration with enterprise IT.
  • Implement automated security monitoring, vulnerability management, and identity solutions for enterprise systems.
  • Develop governance frameworks, security standards, and risk management strategies that align with global security policies.
  • Champion the adoption of CI / CD and DevOps practices to enable faster, more reliable deployments.
  • Ensure disaster recovery, high availability, and system resilience for enterprise platforms.
  • Collaborate with technology teams and external vendors to ensure alignment with enterprise objectives and goals.
  • Mentor and lead enterprise engineering and operations teams, fostering a culture of innovation, excellence, and continuous improvement.
  • Lead and support the development of engineers, providing technical mentorship and constructive feedback.
  • Partner with senior engineers to define a long-term technology roadmap that minimizes operational burdens, ensures scalability, reduces risk, and drives operational sustainability.
  • Collaborate across teams to prioritize, design, and implement strategies that help the organization scale effectively.

What We're Looking For

  • A Bachelor's degree or equivalent experience in technology, engineering, or a related field.
  • Proven experience in enterprise technology, security, and operations, with at least 3 years in a leadership role.
  • Experience implementing CI / CD pipelines, DevOps methodologies, and Infrastructure-as-Code (e.g., AWS Cloud Development Kit, Azure Bicep).
  • Strong understanding of ITIL, Agile, and enterprise IT governance frameworks.
  • Expertise in big data technologies such as Apache Spark, Hadoop, Kafka, and Flink.
  • Hands-on experience with cloud platforms (AWS, GCP, Azure) and cloud-native data solutions (BigQuery, Redshift, Snowflake, Databricks).
  • Proficiency in SQL, Python, or Scala, with experience building and managing data platforms.
  • Knowledge of data modeling, data warehousing, and distributed systems architecture.
  • Essential Skills

  • Proven expertise with Microsoft Azure, AWS, Databricks, and Palantir.
  • Strong understanding of data ingestion, pipelines, governance, security, and data visualization.
  • Experience designing, deploying, and optimizing multi-cloud data platforms that balance cost, performance, and resilience at scale.
  • Hands-on experience with performance tuning, data indexing, and distributed query optimization.
  • Experience working with real-time and batch data streaming architectures.
  • Preferred Skills

  • Successful track record in navigating highly regulated, global environments, ensuring compliance, security, and effective risk management across the enterprise.
  • Expertise in AI / ML-driven data engineering and using intelligent automation to optimize workflows.
  • Why join our team?

    At bp, we provide an excellent working environment and employee benefits such as an open and inclusive culture, a great work-life balance, tremendous learning and development opportunities to craft your career path, life and health insurance, medical care package and many others. We support our people to learn and grow in a diverse and challenging environment. We believe that our team is strengthened by diversity. We are committed to crafting an inclusive environment in which everyone is respected and treated fairly.

    There are many aspects of our employees’ lives that are meaningful, so we offer benefits to enable your work to fit with your life. These benefits can include flexible working options, collaboration spaces in a modern office environment, and many others benefits. Reinvent your career as you help our business meet the challenges of the future.

    Apply now!

    Travel Requirement

    Negligible travel should be expected with this role

    Relocation Assistance

    This role is not eligible for relocation

    Remote Type

    This position is a hybrid of office / remote working

    Legal Disclaimer

    We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, socioeconomic status, neurodiversity / neurocognitive functioning, veteran status or disability status. Individuals with an accessibility need may request an adjustment / accommodation related to bp’s recruiting process. If you would like to request an adjustment / accommodation related to the recruitment process, please contact us. If you are selected for a position and depending upon your role, your employment may be contingent upon adherence to local policy. This may include pre-placement drug screening, medical review of physical fitness for the role, and background checks.

    #J-18808-Ljbffr

    Create a job alert for this search

    Platform Engineering • Kuala Lumpur, Kuala Lumpur, Malaysia

    Related jobs
    • Promoted
    Platform Engineer

    Platform Engineer

    Experian GroupCyberjaya, Selangor, Malaysia
    Work closely with the development team to bring new software releases to production more effectively.Develop and deploy OSS tools for use within the Cloud Operations group.Develop, deploy and manag...Show moreLast updated: 1 day ago
    • Promoted
    T&T Manager - SAP Data Lead (MM / SD or PP) - PH

    T&T Manager - SAP Data Lead (MM / SD or PP) - PH

    Deloitte PLTKuala Lumpur, Malaysia
    Select how often (in days) to receive an alert : T&T Manager - SAP Data Lead (MM / SD or PP) - PH Date : 27 Aug 2025 Service Line / Portfolios : Enterprise Technology & Performance Location : Manila, PH...Show moreLast updated: 10 days ago
    • Promoted
    Senior Manager - Business Development (Medical Consumables)

    Senior Manager - Business Development (Medical Consumables)

    HartalegaBatu Caves, Selangor, Malaysia
    Mun Global is the global platform for premium healthcare and personal protective products across many markets.This position is responsible for : . Lead and manage the full spectrum of the medical cons...Show moreLast updated: 30+ days ago
    • Promoted
    Technical Product Manager – Operational Excellence (Bangkok-based, relocation provided)

    Technical Product Manager – Operational Excellence (Bangkok-based, relocation provided)

    AgodaKuala Selangor, Kuala Selangor, Malaysia
    Technical Product Manager – Operational Excellence (Bangkok-based, relocation provided) at Agoda.This role focuses on enabling Agoda Tech to become more effective in non-coding activities such as i...Show moreLast updated: 1 day ago
    • Promoted
    Scada Lead Engineer

    Scada Lead Engineer

    Avensys ConsultingCyberjaya, Selangor, Malaysia
    Scada Lead position at Avensys Consulting.This role focuses on designing, developing, and deploying SCADA systems, with exposure to Ignition, Keware, Modbus and related technologies.Suitable for ca...Show moreLast updated: 30+ days ago
    Lead Data Engineer

    Lead Data Engineer

    QuantexaKuala Lumpur, Federal Territory of Kuala Lumpur, MY
    Quick Apply
    It isn’t often you get to be part of a tech company that, since 2016, has been innovating the data analytics market in ways no-one else can. Our technology started out in FinTech, helping tackle ser...Show moreLast updated: 17 days ago
    • Promoted
    Regional Lead, Member Engagement and Experience (MEE) - Europe

    Regional Lead, Member Engagement and Experience (MEE) - Europe

    IFACKlang Municipal Council, Klang Municipal Council, Malaysia
    Regional Lead, Member Engagement and Experience (MEE) - Europe.During 2024 IFAC shifted its strategic focus to maximizing member value and experience. The Member Value Proposition (MVP) was created ...Show moreLast updated: 1 day ago
    • Promoted
    Asia Portfolio Leader (APL), Industrial Specialties Division Packaging, Safety & Industrial Bus[...]

    Asia Portfolio Leader (APL), Industrial Specialties Division Packaging, Safety & Industrial Bus[...]

    3MKlang Municipal Council, Klang Municipal Council, Malaysia
    The area portfolio leader for Asia ISD Packaging will be responsible for driving growth and profitability of the packaging tapes business in Asia through area product marketing leadership role.The ...Show moreLast updated: 1 day ago
    • Promoted
    Deployment Engineer- MY (Big Data / Hadoop Admin)

    Deployment Engineer- MY (Big Data / Hadoop Admin)

    Tookitaki Holding PTE LTDKuala Lumpur, Kuala Lumpur, Malaysia
    Job Title : Deployment Engineer | Department : Services Delivery | Reporting To : Regional Head of Service Delivery.The Deployment Engineer is a critical technical role within Tookitaki’s Services Del...Show moreLast updated: 27 days ago
    • Promoted
    EMEA Senior Enterprise Sales Executive

    EMEA Senior Enterprise Sales Executive

    7SIGNALSeremban, Negeri Sembilan, Malaysia
    We’re looking for a dynamic and experienced.Senior Enterprise Sales Executive.SaaS solutions to customers in.Manufacturing, Distribution, Healthcare, and Retail. The ideal candidate will bring 7+ ye...Show moreLast updated: 1 day ago
    • Promoted
    Data Analytics Lead

    Data Analytics Lead

    LearntasticSubang Jaya, Selangor, Malaysia
    About Us : We are a fast-growing continuous education company with multiple brands in the e-learning and certification space. Our mission is to provide high-quality, accessible courses for profession...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Kris Infotech Sdn BhdKuala Lumpur, Kuala Lumpur, Malaysia
    Python, PySpark, and Databricks.This opportunity is open to Malaysian citizens due to project requirements.Design, develop, and maintain data pipelines and ETL processes. Collaborate with data scien...Show moreLast updated: 1 day ago
    • Promoted
    Data Analysis Engineer

    Data Analysis Engineer

    iSoftStoneKuala Lumpur, Kuala Lumpur, Malaysia
    HR & Talent Acquisition Professional | 7+ Years’ Experience | Open for New Roles.Responsible for overseas mobile game business related security strategy development, operation, videos analysis, rel...Show moreLast updated: 1 day ago
    • Promoted
    Project Manager Analyst

    Project Manager Analyst

    ArbitrumNilai, Negeri Sembilan, Malaysia
    Founded in 2015 with the mission to protect the open economy, OpenZeppelin is the world leader in securing blockchain applications and smart contracts. Our Open-Source Contract Libraries are a publi...Show moreLast updated: 1 day ago
    • Promoted
    Technical Marketing Engineer

    Technical Marketing Engineer

    Infotree Global SolutionsNilai, Negeri Sembilan, Malaysia
    Job title : Developer : Technical Marketing - III.Max salary budget : RM8,000 / month.Experience : 5+ years in technical roles, 2+ years with developers, coding skills, and hands-on AI / edge / IoT experienc...Show moreLast updated: 16 days ago
    • Promoted
    Master Data Manager

    Master Data Manager

    DanaherKuala Lumpur, Kuala Lumpur, Malaysia
    Are you ready to accelerate your potential and make a real difference within life sciences, diagnostics and biotechnology?. At Pall Corporation, one of Danaher’s 15+ operating companies, our work sa...Show moreLast updated: 1 day ago
    • Promoted
    Senior Business Analyst - Insurance, Cantonese Speaker (Fully Remote)

    Senior Business Analyst - Insurance, Cantonese Speaker (Fully Remote)

    CoverGoSeremban, Negeri Sembilan, Malaysia
    Working on the latest tech for the Insurtech Market Leader.At CoverGo, our mission is to empower all insurance companies to make insurance 100% digital and accessible to everyone.We are a leading g...Show moreLast updated: 18 days ago
    • Promoted
    Senior Data Analyst

    Senior Data Analyst

    AirAsiaSepang, Selangor, Malaysia
    Partner with business and project leaders to deeply understand their goals, define critical metrics and KPIs, and deliver insights that drive action. Analyze complex datasets to uncover trends, perf...Show moreLast updated: 1 day ago