Talent.com
Tawaran kerja ini tidak tersedia di negara anda.
Senior Data Engineer

Senior Data Engineer

Handshakes Technology (M) Sdn BhdMalaysia
12 jam yang lalu
Penerangan pekerjaan

As a Senior Data Engineer, you will be responsible for designing and implementing resilient and scalable data pipelines.  With your years of experience, you will partner with the different pillars of the Data and AI, Engineering, and Product teams to meet their data engineering needs.

The Senior Data Engineer will have responsibilities such as, but not limited to :

  • Design and develop scalable data transformation pipelines using Python and Scala.
  • Work closely with business stakeholders to understand data requirements and develop solutions to meet their needs.
  • Develop and maintain ETL (Extract, Transform, Load) processes for large and complex data sets.
  • Ensure the integrity and accuracy of our data by implementing appropriate data validation and quality control measures.
  • Collaborate with the Solution Architect to design and implement data architectures that are scalable, reliable, and secure.
  • Monitor data transformation processes and identify opportunities for optimization and improvement.
  • Stay up-to-date with the latest data transformation technologies and methodologies and evaluate their suitability for our organization.

As an experienced Senior Data Engineer, you would have :

  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • years of experience in data engineering, with a focus on data transformation using Python or Scala.
  • Strong proficiency in Python and related data transformation libraries, such as Pandas, Numpy, and Scipy.
  • Proven experience in designing and developing scalable and reliable data pipelines.
  • Strong knowledge of SQL and database systems.
  • Familiarity with NoSQL databases such as MongoDB, Cassandra, or DynamoDB.
  • Good knowledge in distributed computing frameworks such as Apache Spark is a bonus.
  • Knowledge of cloud-based data platforms such as Amazon Web Services (AWS) or Microsoft Azure.
  • Familiarity with data security and governance best practices.
  • Excellent communication and collaboration skills.
  • Ability to work independently and as part of a team.
    • Buat amaran kerja untuk carian ini

    Senior Data Engineer • Malaysia