Talent.com
This job offer is not available in your country.
Data Engineer -AWS

Data Engineer -AWS

CapgeminiKuala Lumpur, Malaysia
2 days ago
Job description

Data Engineer -AWS About the job you are considering

Choosing Capgemini means choosing apany where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborativemunity of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations unlock the value of technology and build a more sustainable, more inclusive world.

Your Role

  • You will be responsible for designing and implementing scalable and robust data infrastructure to support our client's data processing needs.
  • Collaborate with data scientists, analysts, and other cross-functional teams to understand data requirements and implement effective solutions.
  • Build and optimize large-scale data processing systems for both batch and real-time processing.
  • Ensure the quality, consistency, and integrity of data through effective data modeling andernance.
  • Implement and maintain data warehousing solutions to support business intelligence and reporting needs.
  • Troubleshoot and resolve issues related to data pipelines and storage layers.
  • Stay up-to-date with the latest trends and advancements in data engineering and big data technologies.

Your Skills and Experience

  • The ideal candidate should have a strong background in data engineering (Python, PySpark, DataBricks), ETL processes, and data modeling and 3+ years of AWS experience.
  • Design, develop, and maintain data pipelines and ETL processes.
  • Previous experience in programming Python; Hadoop Stack (Hive, Spark (Core and Streaming), Kafka, Flink, NIFI)
  • Previous experience working on stream transformation using Spark Streaming or Flink; working on change data capture in a big data ecosystem; building real-time or batch ingestion and transformation data pipelines;
  • Good working experience and knowledge of AWS - S3, EMR, Redshift
  • Previous experience in implementing the Data Vault & start schema Framework using Redshift
  • Should be able to work with DevOps team on Orchestrating Airflow works
  • Good understanding of iPython and Bigdata and Hands-on SQL
  • Certification on AWS will be added advantage.
  • Why you should consider Capgemini

    Growing clients' businesses while building a more sustainable, more inclusive future is a tough ask. When you join Capgemini, you'll join a thrivingpany and be part of a diverse collective of free-thinkers, entrepreneurs and industry experts. We find new ways technology can help us reimagine what's possible. It's why, together, we seek out opportunities that will transform the world's leading businesses, and it's how you'll gain the experiences and connections you need to shape your future. By learning from each other every day, sharing knowledge, and always pushing yourself to do better, you'll build the skills you want. You'll use your skills to help our clients leverage technology to innovate and grow their business. So, it might not always be easy, but making the world a better place rarely is.

    About Capgemini

    Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society. It is a responsible and diverse group of 340,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market leading capabilities in AI, cloud and data,bined with its deep industry expertise and partner ecosystem. The Group reported 2023 global revenues of € billion.

    GetTheFutureYouWant | capgemini Job ID UwoItoIBqG8Q

    Create a job alert for this search

    Data Engineer • Kuala Lumpur, Malaysia

    Related jobs
    Data Engineer

    Data Engineer

    BASF Asia-Pacific Service Centre Sdn. Bhd.Kuala Lumpur, Malaysia
    Digital Hub Kuala Lumpur attracts, inspire and develop diverse talents who will elevate BASF’s digital journey.As one of the world’s largest chemical companies, BASF is on a mission to create chemi...Show moreLast updated: 30+ days ago
    Junior Data Engineer

    Junior Data Engineer

    Nutworkz Sdn BhdKuala Lumpur, MY
    We are seeking a motivated and enthusiastic Data Engineer to join our dynamic team.This full-time position offers hands-on experience in data engineering, allowing you to work on real projects and ...Show moreLast updated: 30+ days ago
    Data Engineer

    Data Engineer

    SwiftKuala Lumpur, Malaysia
    We’re the world’s leading provider of secure financial messaging services, headquartered in Belgium.We are the way the world moves value – across borders, through cities and overseas.No other organ...Show moreLast updated: 30+ days ago
    Data Engineer

    Data Engineer

    Prudential plcKuala Lumpur, Malaysia
    Data EngineerPrudential's purpose is to be partners for every life and protectors for every future.Our purpose encourages everything we do by creating a culture in which diversity is celebrated and...Show moreLast updated: 17 days ago
    Senior Data Engineer

    Senior Data Engineer

    Bertelsmann SE & Co. KGaAKuala Lumpur, 14, MY
    Selects the right tools and technologies for data ingestion, transformation, and storage.Implements and maintains connectors for data ingestion from various sources. Ensures the quality, integrity, ...Show moreLast updated: 30+ days ago
    AWS Engineer

    AWS Engineer

    ExxonMobil CorporationKuala Lumpur, MY
    Design Exchange & SharePoint server setup for company based on project requirements, security and controls.Require ability to provide a high availability coexistence messaging and content managemen...Show moreLast updated: 16 days ago
    lead / Senior data engineer : Python / AWS / Databricks

    lead / Senior data engineer : Python / AWS / Databricks

    Capcon AsiaKuala Lumpur, Malaysia
    Quick Apply
    Data driven technology spin off from a leading aviation strategy, logistics and air cargo consultancy.Building data-driven SaaS tools that help airlines make informed commercial decisions from; rou...Show moreLast updated: 12 days ago
    Data Engineer

    Data Engineer

    SnaphuntKuala Lumpur, Malaysia
    Work alongside & learn from best in class talent.Excellent career development opportunities.Develop scalable data architectures and systems that can handle large volumes of data and support real-ti...Show moreLast updated: 30+ days ago
    Data Engineer

    Data Engineer

    MoneyLionKuala Lumpur, Malaysia
    Assist with reviewing and interpreting business and technical requirements with a focus on data objectives of the product. Identify requirements and develop data delivery solutions.Implementpany pol...Show moreLast updated: 17 days ago
    Data Engineer II

    Data Engineer II

    ZaloraKuala Lumpur, Malaysia
    Collaborate within a data engineering team, offering guidance, mentorship, and assistance.Work with data scientists and analysts to understand their data requirements and develop suitable solutions...Show moreLast updated: 30+ days ago
    Security Data Engineer

    Security Data Engineer

    TencentKuala Lumpur, Malaysia
    Tencent Games was established in 2003.We are a leading global platform for game development, operations and publishing, and the largest online game community in China. Tencent Games has developed an...Show moreLast updated: 17 days ago
    AWS Engineer

    AWS Engineer

    ExxonMobilKuala Lumpur, 14, MY
    At ExxonMobil, our vision is to lead in energy innovations that advance modern living and a net-zero future.As one of the world’s largest publicly traded energy and chemical companies, we are power...Show moreLast updated: 30+ days ago
    Data Engineer

    Data Engineer

    EZYPAYKuala Lumpur, Malaysia
    As part of the Data & Reporting team, you will assist in the back-end design, implementation, and ongoing operation of Ezypay's business intelligence platform (PowerBI). Design and develop solutions...Show moreLast updated: 17 days ago
    Senior Data Engineer

    Senior Data Engineer

    Arvato Digital ServicesKuala Lumpur, MY, 50400
    Selects the right tools and technologies for data ingestion, transformation, and storage.Implements and maintains connectors for data ingestion from various sources. Ensures the quality, integrity, ...Show moreLast updated: 17 days ago
    Regional Senior Data Engineer

    Regional Senior Data Engineer

    ZUS CoffeeKuala Lumpur, MY
    Position Responsibilities -Design and Develop Data Pipelines : Create and maintain efficient, reliable, and scalable data pipelines that extract, transform, and load (ETL) data from diverse sourc...Show moreLast updated: 26 days ago
    Data Engineer

    Data Engineer

    iSoftStoneKuala Lumpur, MY
    About Us : A leading global technology conglomerate renowned for its extensive ecosystem of digital services and platforms. With a strong presence in cloud computing, gaming, social media, and enterp...Show moreLast updated: 20 days ago
    Data Engineer

    Data Engineer

    Mandrill TechKuala Lumpur, Malaysia
    Established in Kuala Lumpur since 2015, Mandrill Tech is a fast growing technology company.It serves many clients from various lines of industry. Being an MSC certified company, Mandrill Tech is rec...Show moreLast updated: 30+ days ago
    Data Networks Engineer

    Data Networks Engineer

    AS White GlobalKuala Lumpur, Malaysia
    Our partner is an Australia-based leading communications and Telecom software company, listed on the Australian Stock Exchange since 2006. UCaaS and collaboration services.Over 6M+ on-net phone numb...Show moreLast updated: 30+ days ago