This job offer is not available in your country.

Data Engineer (Spark, SQL)

Unison GroupKuala Lumpur, Kuala Lumpur, Malaysia

1 day ago

Job description

Overview

We are looking for a proficient Data Engineer with strong skills in Spark and SQL to join Unison Group. The successful candidate will be responsible for designing, building, and managing data pipelines that facilitate real-time data processing. This role involves optimizing data flow and enhancing data quality to support the analytical needs of various teams within the organization.

Base pay range

SGD48,000.00 / yr - SGD95,000.00 / yr

This range is provided by Unison Group. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Responsibilities

Develop and maintain robust data pipelines using Apache Spark to process large datasets efficiently
Utilize SQL for data querying, manipulation, and management across various relational database systems
Collaborate with data scientists and analytics teams to understand data requirements and deliver suitable solutions
Implement data transformation and aggregation processes to optimize data for analysis
Monitor and troubleshoot data pipelines, ensuring high availability and reliability
Perform data quality checks and maintain data integrity throughout the data lifecycle
Stay updated on industry trends and best practices in data engineering, particularly in Spark and SQL technologies

Requirements

Bachelor's degree in Computer Science, Information Technology, or a related field

Experience as a Data Engineer, with a focus on Spark and SQL

Good to have experience in Banking / Finance domain

Proficiency in Spark for distributed data processing and ability to write efficient Spark jobs

Strong SQL skills, with experience working with relational databases (e.g., MySQL, PostgreSQL, Oracle)

Experience with data integration, ETL processes, and data warehousing concepts

Knowledge of big data technologies and frameworks is a plus

Strong analytical and problem-solving skills

Excellent communication and teamwork capabilities

Benefits

Salary : SGD 6000 - 8000

Great Work Culture

Includes Standard Annual and Sick Leave

Job details

Seniority level : Associate

Employment type : Full-time

Job function : Information Technology

Industries : IT Services and IT Consulting

#J-18808-Ljbffr

Create a job alert for this search

Data Engineer • Kuala Lumpur, Kuala Lumpur, Malaysia