Talent.com
Tawaran kerja ini tidak tersedia di negara anda.
DevOps Engineer - Data Lake

DevOps Engineer - Data Lake

PayNet (Payments Network Malaysia)Kuala Lumpur, Kuala Lumpur, Malaysia
25 hari lalu
Penerangan pekerjaan

Join to apply for the DevOps Engineer - Data Lake role at PayNet (Payments Network Malaysia) .

As a Principal DevOps Engineer supporting DataOps, you will play a crucial role in enabling efficient and reliable data pipeline building, data analysis, and data governance. Your primary responsibility will be to ensure smooth data ingestion into the data lake or data warehouse, enabling downstream data consumption for Data Scientists, Analysts, and other stakeholders. You will utilize various AWS services such as MSK / Kafka, S3, EMR or Glue, Lakeformation, Athena, QuickSight, and manage ingestion from different databases like MS SQL, MySQL, Oracle, and PostgreSQL.

Responsibilities

  • Data Pipeline Build

Collaborate with Data Engineers to design, implement, and optimize data pipelines.

  • Ensure efficient and reliable data ingestion processes from various sources into the data lake or data warehouse.
  • Implement data validation and quality checks to maintain data integrity throughout the pipeline.
  • Data Analysis Support
  • Assist Data Scientists and Analysts in their routine analytical work by providing data access and query support.

  • Optimize data storage and retrieval mechanisms to enhance performance and efficiency.
  • Collaborate with stakeholders to identify and implement solutions for data analysis and reporting requirements.
  • Data Governance And Security
  • Utilize AWS Lakeformation and other relevant tools to establish and enforce data governance policies.

  • Implement security measures and access controls to protect sensitive data.
  • Collaborate with stakeholders to ensure compliance with data privacy regulations.
  • Functional Competencies

  • Technical Expertise
  • Strong expertise in AWS services such as MSK / Kafka, S3, EMR or Glue, Lakeformation, Athena, and QuickSight.

  • Proficient in database management systems like MS SQL, MySQL, Oracle, and PostgreSQL.
  • Familiarity with Change Data Capture (CDC) mechanisms and practices.
  • Solid understanding of data pipeline architecture, ETL processes, and data integration techniques.
  • Collaboration And Communication
  • Excellent collaboration skills to work closely with Data Engineers, Data Scientists, Analysts, and stakeholders.

  • Strong communication skills to effectively convey technical concepts to both technical and non-technical audiences.
  • Ability to collaborate with cross-functional teams and promote a culture of knowledge sharing and continuous improvement.
  • Problem-solving And Troubleshooting
  • Proven ability to identify and resolve complex technical issues related to data ingestion, processing, and analysis.

  • Experience in performance tuning, optimizing data storage and retrieval, and addressing scalability challenges.
  • Strong analytical and problem-solving skills to diagnose and troubleshoot system-level issues.
  • Automation And Infrastructure As Code (IaC)
  • Proficiency in infrastructure automation using tools like Terraform, CloudFormation

  • Experience in managing and administering Kubernetes on-premises or EKS in AWS
  • Experience with version control systems (e.g., Git) and CI / CD pipelines for automated deployments.
  • Understanding of Infrastructure as Code (IaC) principles to maintain reproducible and scalable environments.
  • Proficient in programming languages such as Python, Golang, Java
  • Minimum Qualifications

  • Bachelors Degree in Computer Science, Information Systems Technology, or Software Engineering
  • More than 7 years of relevant experience in Information Technology, especially in the field of DevOps
  • Relevant work experience in the Financial Services and / or Technology sectors would be an added advantage
  • Excellent in both English and Bahasa Malaysia
  • Seniority level

  • Mid-Senior level
  • Employment type

  • Full-time
  • Job function

  • Engineering and Information Technology
  • #J-18808-Ljbffr

    Buat amaran kerja untuk carian ini

    Data Engineer • Kuala Lumpur, Kuala Lumpur, Malaysia

    Pekerjaan yang berkaitan
    • Dinaikkan pangkat
    DevOps Engineer

    DevOps Engineer

    iSoftStoneKuala Lumpur, Kuala Lumpur, Malaysia
    SoftStone Federal Territory of Kuala Lumpur, Malaysia.A leading global technology conglomerate renowned for its extensive ecosystem of digital services and platforms. With a strong presence in cloud...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu
    • Dinaikkan pangkat
    • Baharu!
    Presales Engineer (Cloud Native - DevOps / K8S)

    Presales Engineer (Cloud Native - DevOps / K8S)

    Agensi Pekerjaan Genie Hunt TalentKuala Lumpur, Kuala Lumpur, Malaysia
    You will be responsible for providing technical guidance, support and solutions to our customers in the cloud native and container platform area. You will also work closely with our internal teams t...Tunjukkan lagiKemas kini terakhir: 7 jam yang lalu
    • Dinaikkan pangkat
    Cloud Infrastructure Engineer (Azure / AWS)

    Cloud Infrastructure Engineer (Azure / AWS)

    SingtelKuala Lumpur, Kuala Lumpur, Malaysia
    Singtel is using AWS and Azure platforms to accelerate our transformation to become a TechCo.The purpose of this role is to enhance operational efficiency and scalability through automation and Inf...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu
    • Dinaikkan pangkat
    DevOps Engineer

    DevOps Engineer

    N1 HealthcareCyberjaya, Selangor, Malaysia
    Healthcare, we are transforming how individuals understand and manage their health.Architect High-Availability Infrastructure : . Design, implement, and automate a sophisticated, multi-cloud infrastru...Tunjukkan lagiKemas kini terakhir: 1 hari yang lalu
    • Dinaikkan pangkat
    System DevOps Engineer

    System DevOps Engineer

    iSoftStoneKuala Lumpur, Kuala Lumpur, Malaysia
    Direct message the job poster from iSoftStone.Project Coordinator | Recruitment | Management | Content Creator | Video Editing | HR | PA. Participate in basic management, setup, and maintenance of p...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu
    • Dinaikkan pangkat
    • Baharu!
    DevOps Engineer - Fintech

    DevOps Engineer - Fintech

    TIMESCONSULTKuala Lumpur, Kuala Lumpur, Malaysia
    Assistant Manager - HR and Operation @ AskHeadHunter.Develop and deploy reliable, secure, and scalable CI / CD pipelines leveraging AWS services like CodeBuild, CodeDeploy, and CodePipeline.Oversee a...Tunjukkan lagiKemas kini terakhir: 7 jam yang lalu
    Senior DevOps Engineer

    Senior DevOps Engineer

    Flintex Consulting Pte LtdKuala Lumpur, 14, my
    Quick Apply
    We are seeking a highly skilled and motivated senior DevOps Engineer to join our team.The ideal candidate will be responsible for designing, implementing, and maintaining our CI / CD pipelines, autom...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu
    • Dinaikkan pangkat
    Cloud Engineer

    Cloud Engineer

    HytechKuala Lumpur, Kuala Lumpur, Malaysia
    Hytech Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia.Hytech Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia. We specialize in providing digital transformation for fintech and f...Tunjukkan lagiKemas kini terakhir: 1 hari yang lalu
    • Dinaikkan pangkat
    Deployment Engineer- MY (Big Data / Hadoop Admin)

    Deployment Engineer- MY (Big Data / Hadoop Admin)

    Tookitaki Holding PTE LTDKuala Lumpur, Kuala Lumpur, Malaysia
    Job Title : Deployment Engineer | Department : Services Delivery | Reporting To : Regional Head of Service Delivery.The Deployment Engineer is a critical technical role within Tookitaki’s Services Del...Tunjukkan lagiKemas kini terakhir: 28 hari yang lalu
    Devops Engineer

    Devops Engineer

    AethirPetaling Jaya, Selangor, MY
    Quick Apply
    By leveraging a highly distributed cloud computing infrastructure, we help GPU providers serve AI and gaming customers at scale. Our mission is to deliver powerful AI chips for enterprise clients wh...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu
    • Dinaikkan pangkat
    Engineer, Cloud Infrastructure (AWS / Azure)

    Engineer, Cloud Infrastructure (AWS / Azure)

    SingtelKuala Lumpur, Kuala Lumpur, Malaysia
    Singtel Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia.We are seeking a Cloud Infrastructure Engineer to enhance operational efficiency and scalability through automation and Infrastruct...Tunjukkan lagiKemas kini terakhir: 1 hari yang lalu
    • Dinaikkan pangkat
    DevOps Engineer I

    DevOps Engineer I

    MintelSepang, Malaysia
    Mintel Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia Join or sign in to find your next job.Mintel Mintel Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia Join to apply for the....Tunjukkan lagiKemas kini terakhir: 4 hari yang lalu
    • Dinaikkan pangkat
    DevOps Engineer

    DevOps Engineer

    SeedifySubang Jaya, Malaysia
    Seedworld Studios is looking for an experienced AWS DevOps professional who can design and implement secure, scalable, and highly available cloud solutions. The ideal candidate will have hands-on ex...Tunjukkan lagiKemas kini terakhir: 4 hari yang lalu
    Devops Engineer

    Devops Engineer

    Unison GroupKuala Lumpur, Federal Territory of Kuala Lumpur, MY
    Quick Apply
    Proven experience with CI / CD tools (e.Jenkins, Gitea, Sonar, Nexus, Azure Devops, Terraform, Liquibase).Hands-on experience with cloud platforms (e. Proficiency in scripting languages (e.Bash, Power...Tunjukkan lagiKemas kini terakhir: 18 hari yang lalu
    Linux and Devops Engineer

    Linux and Devops Engineer

    RM Staffing B.V.Kuala Lumpur, 10, MY
    We are seeking a highly skilled.The ideal candidate will have deep expertise in.Linux systems administration, automation, cloud infrastructure, and CI / CD pipelines. This role requires hands-on techn...Tunjukkan lagiKemas kini terakhir: 3 hari yang lalu
    Lead / Senior DevOps Engineer

    Lead / Senior DevOps Engineer

    Two95 International Inc.Kuala Lumpur, Federal Territory of Kuala Lumpur, MY
    Quick Apply
    We currently have an opening for a DevOps.You will cooperate with interdisciplinary teams in projects.Maintain a secure and reliable infrastructure for delivery services. Operate and maintaining pro...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu
    • Dinaikkan pangkat
    DevOps Support Engineer

    DevOps Support Engineer

    DXC Technology Inc.Petaling Jaya, Selangor, Malaysia
    Job Description : • • • •DXC Technology • • helps global companies run their mission-critical systems and operations while modernizing IT, optimizing data architectures, and ensuring security and scalabil...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu
    Senior DevOps Engineer

    Senior DevOps Engineer

    Talent SwitchSerdang, Selangor, Malaysia
    Quick Apply
    Were looking for a Senior DevOps Engineer with 5+ years of experience in DevOps and a passion for scalable, secure, and automated cloud infrastructure. You'll play a key role in delivering our SaaS ...Tunjukkan lagiKemas kini terakhir: 7 hari yang lalu
    • Dinaikkan pangkat
    Senior Specialist, DevOps

    Senior Specialist, DevOps

    TNG DigitalKuala Lumpur, Kuala Lumpur, Malaysia
    Let's connect - We're hiring! | Fintech | Openings in both IT and non-IT fields.We fuel the ideas and ambitions of our people with an environment built on Our DNA of Love, Entrepreneurship, Agility...Tunjukkan lagiKemas kini terakhir: 23 hari yang lalu
    Senior Devops Engineer

    Senior Devops Engineer

    AethirPetaling Jaya, Selangor, MY
    Quick Apply
    By leveraging a highly distributed cloud computing infrastructure, we help GPU providers serve AI and gaming customers at scale. Our mission is to deliver powerful AI chips for enterprise clients wh...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu