Talent.com
Tawaran kerja ini tidak tersedia di negara anda.
Data Engineer -AWS

Data Engineer -AWS

CapgeminiKuala Lumpur, Malaysia
30+ hari lalu
Penerangan pekerjaan

Data Engineer -AWS About the job you are considering

Choosing Capgemini means choosing apany where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborativemunity of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations unlock the value of technology and build a more sustainable, more inclusive world.

Your Role

  • You will be responsible for designing and implementing scalable and robust data infrastructure to support our client's data processing needs.
  • Collaborate with data scientists, analysts, and other cross-functional teams to understand data requirements and implement effective solutions.
  • Build and optimize large-scale data processing systems for both batch and real-time processing.
  • Ensure the quality, consistency, and integrity of data through effective data modeling andernance.
  • Implement and maintain data warehousing solutions to support business intelligence and reporting needs.
  • Troubleshoot and resolve issues related to data pipelines and storage layers.
  • Stay up-to-date with the latest trends and advancements in data engineering and big data technologies.

Your Skills and Experience

  • The ideal candidate should have a strong background in data engineering (Python, PySpark, DataBricks), ETL processes, and data modeling and 3+ years of AWS experience.
  • Design, develop, and maintain data pipelines and ETL processes.
  • Previous experience in programming Python; Hadoop Stack (Hive, Spark (Core and Streaming), Kafka, Flink, NIFI)
  • Previous experience working on stream transformation using Spark Streaming or Flink; working on change data capture in a big data ecosystem; building real-time or batch ingestion and transformation data pipelines;
  • Good working experience and knowledge of AWS - S3, EMR, Redshift
  • Previous experience in implementing the Data Vault & start schema Framework using Redshift
  • Should be able to work with DevOps team on Orchestrating Airflow works
  • Good understanding of iPython and Bigdata and Hands-on SQL
  • Certification on AWS will be added advantage.
  • Why you should consider Capgemini

    Growing clients' businesses while building a more sustainable, more inclusive future is a tough ask. When you join Capgemini, you'll join a thrivingpany and be part of a diverse collective of free-thinkers, entrepreneurs and industry experts. We find new ways technology can help us reimagine what's possible. It's why, together, we seek out opportunities that will transform the world's leading businesses, and it's how you'll gain the experiences and connections you need to shape your future. By learning from each other every day, sharing knowledge, and always pushing yourself to do better, you'll build the skills you want. You'll use your skills to help our clients leverage technology to innovate and grow their business. So, it might not always be easy, but making the world a better place rarely is.

    About Capgemini

    Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society. It is a responsible and diverse group of 340,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market leading capabilities in AI, cloud and data,bined with its deep industry expertise and partner ecosystem. The Group reported 2023 global revenues of € billion.

    GetTheFutureYouWant | capgemini Job ID UwoItoIBqG8Q

    Buat amaran kerja untuk carian ini

    Data Engineer • Kuala Lumpur, Malaysia