Data Engineer (SQL, Python, Spark, Hive, Hadoop)

Role Overview

We are looking for a skilled Data Engineer with 5 years of hands-on experience in designing, developing, and optimizing big data pipelines and solutions. The ideal candidate will have strong expertise in SQL, Python, Apache Spark, Hive, and Hadoop ecosystems and will be responsible for building scalable data platforms to support business intelligence, analytics, and machine learning use cases.

Key Responsibilities

• Design, develop, and maintain scalable ETL pipelines using Spark, Hive, and Hadoop.
• Write efficient SQL queries for data extraction, transformation, and analysis.
• Develop automation scripts and data processing workflows using Python .
• Optimize data pipelines for performance, reliability, and scalability .
• Work with structured and unstructured data from multiple sources.
• Ensure data quality, governance, and security throughout the data lifecycle.
• Collaborate with cross-functional teams (Data Scientists, Analysts, and Business stakeholders) to deliver data-driven solutions.
• Monitor and troubleshoot production data pipelines.

Requirements

Required Skills & Qualifications