Tawaran kerja ini tidak tersedia di negara anda.
Data Engineer (SQL, Python, Spark, Hive, Hadoop)
Unison GroupKuala Lumpur, Kuala Lumpur, Malaysia6 jam yang lalu
Penerangan pekerjaan5+ years of experience in Data Engineering / Big Data development. Strong expertise in SQL (query optimization, performance tuning, stored procedures). Proficiency in Python for data manipulation, scripting, and automation. Hands-on experience with Apache Spark (PySpark / Scala) for large-scale data processing. Solid knowledge of Hive for querying and managing data in Hadoop environments. Strong working knowledge of Hadoop ecosystem (HDFS, YARN, MapReduce, etc.). Experience with data pipeline orchestration tools (Airflow, Oozie, or similar) is a plus. Familiarity with cloud platforms (AWS, Azure, or GCP) is preferred. Excellent problem-solving, debugging, and communication skills Mid-Senior level Full-time Other IT Services and IT Consulting
Role Overview
We are looking for a skilled Data Engineer with 5 years of hands-on experience in designing, developing, and optimizing big data pipelines and solutions. The ideal candidate will have strong expertise in SQL, Python, Apache Spark, Hive, and Hadoop ecosystems and will be responsible for building scalable data platforms to support business intelligence, analytics, and machine learning use cases.
Responsibilities
- Design, develop, and maintain scalable ETL pipelines using Spark, Hive, and Hadoop.
- Write efficient SQL queries for data extraction, transformation, and analysis.
- Develop automation scripts and data processing workflows using Python.
- Optimize data pipelines for performance, reliability, and scalability.
- Work with structured and unstructured data from multiple sources.
- Ensure data quality, governance, and security throughout the data lifecycle.
- Collaborate with cross-functional teams (Data Scientists, Analysts, and Business stakeholders) to deliver data-driven solutions.
- Monitor and troubleshoot production data pipelines.
Requirements
Required Skills & Qualifications
Seniority level
Employment type
Job function
Industries
#J-18808-Ljbffr
Buat amaran kerja untuk carian ini
Data Engineer • Kuala Lumpur, Kuala Lumpur, Malaysia
Pekerjaan yang berkaitan
Hiring Local Malaysians only - CONTRACT JOB - 12 MONTHS (EXTENDABLE).DATA ENGINEER - IT with Extensive experience in "Healthcare ".
With Minimum Experience - 3 years & Maximun Experience - 15 ye...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu
![Asia Portfolio Leader (APL), Industrial Specialties Division Packaging, Safety & Industrial Bus[...]](https://cdn-logos.talent.com/v1/logo/image?feedcode=whatjobs-my&company_name=3M)
It isn’t often you get to be part of a tech company that, since 2016, has been innovating the data analytics market in ways no-one else can.
Our technology started out in FinTech, helping tackle ser...Tunjukkan lagiKemas kini terakhir: 17 hari yang lalu
Data Engineer
Two95 International Inc.Kuala Lumpur, Federal Territory of Kuala Lumpur, MYQuick Apply
- Dinaikkan pangkat
- Baharu!
Junior Full Stack Engineer (Cantonese Speaker)
FastLane GroupKlang Municipal Council, Klang Municipal Council, Malaysia Junior Full Stack Engineer (fully remote).Hong Kong based client, a construction tech company.In this role, you will contribute to the development of innovative software solutions that transform th...Tunjukkan lagiKemas kini terakhir: 6 jam yang lalu
- Dinaikkan pangkat
- Baharu!
Freelance AI Solutions Engineer - Generative AI & Data Workflows
MindriftKepong, Kuala Lumpur, Malaysia Freelance AI Solutions Engineer - Generative AI & Data Workflows.Be among the first 25 applicants.This opportunity is only for candidates currently residing in the specified country.Your location m...Tunjukkan lagiKemas kini terakhir: 6 jam yang lalu
- Dinaikkan pangkat
- Baharu!
EMEA Senior Enterprise Sales Executive
7SIGNALKlang City, Selangor, Malaysia We’re looking for a dynamic and experienced.Senior Enterprise Sales Executive.SaaS solutions to customers in.Manufacturing, Distribution, Healthcare, and Retail.
The ideal candidate will bring 7+ ye...Tunjukkan lagiKemas kini terakhir: 6 jam yang lalu
- Dinaikkan pangkat
- Baharu!
Senior.NET Developer
EcoVadisKlang City, Selangor, Malaysia Work smart, have fun and make an impact!.Our purpose is to guide all companies toward a sustainable world.EcoVadis is the leading provider of business sustainability ratings.Our solutions are backe...Tunjukkan lagiKemas kini terakhir: 12 jam yang lalu
- Dinaikkan pangkat
- Baharu!
Senior Conversion Optimization Analyst (Remote)
XsollaPort Klang, Port Klang, Malaysia At Xsolla, we believe that great games begin as ideas, driven by the curiosity, dedication, and grit of creators around the world.
Our mission is to empower these visionaries by providing the suppor...Tunjukkan lagiKemas kini terakhir: 6 jam yang lalu
- Dinaikkan pangkat
- Baharu!
Asia Portfolio Leader (APL), Industrial Specialties Division Packaging, Safety & Industrial Bus[...]
3MKuala Selangor, Kuala Selangor, Malaysia The area portfolio leader for Asia ISD Packaging will be responsible for driving growth and profitability of the packaging tapes business in Asia through area product marketing leadership role.The ...Tunjukkan lagiKemas kini terakhir: 6 jam yang lalu
- Dinaikkan pangkat
Cloud Engineer
XtremaxKuala Lumpur, Kuala Lumpur, Malaysia Xtremax Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia.Xtremax Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia.
Be among the first 25 applicants.Get AI-powered advice on this jo...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu
- Dinaikkan pangkat
- Baharu!
System Analyst (C#.Net, SQL Server)
MindteckSeremban, Negeri Sembilan, Malaysia Be among the first 25 applicants.Direct message the job poster from Mindteck.Business requirement gathering, analysis, design, development and support for MES, Manufacturing and Quality application...Tunjukkan lagiKemas kini terakhir: 6 jam yang lalu
- Dinaikkan pangkat
- Baharu!
Data Analysis Engineer
iSoftStoneKuala Lumpur, Kuala Lumpur, Malaysia HR & Talent Acquisition Professional | 7+ Years’ Experience | Open for New Roles.Responsible for overseas mobile game business related security strategy development, operation, videos analysis, rel...Tunjukkan lagiKemas kini terakhir: 6 jam yang lalu
- Dinaikkan pangkat
QA Engineer (Malaysia-Remote)
MATRIXX SoftwareNilai, Negeri Sembilan, Malaysia We are looking for a QA Software Engineer to expand our R&D team in Malaysia.In this role, you will focus on ensuring the quality, reliability, and performance of our MATRIXX product and customer s...Tunjukkan lagiKemas kini terakhir: 13 hari yang lalu
- Dinaikkan pangkat
- Baharu!
Sr Engineer, Continuous Improvement
AnsellSeremban, Negeri Sembilan, Malaysia At Ansell, we stay two steps ahead of workplace risk to deliver innovative safety solutions that enhance people's quality of life.
As a global leader in protection solutions, we design and develop a...Tunjukkan lagiKemas kini terakhir: 6 jam yang lalu
- Dinaikkan pangkat
Technical Marketing Engineer
Infotree Global SolutionsKepong, Kuala Lumpur, Malaysia Job title : Developer : Technical Marketing - III.Max salary budget : RM8,000 / month.Experience : 5+ years in technical roles, 2+ years with developers, coding skills, and hands-on AI / edge / IoT experienc...Tunjukkan lagiKemas kini terakhir: 15 hari yang lalu
- Dinaikkan pangkat
Senior Business Analyst - Insurance, Cantonese Speaker (Fully Remote)
CoverGoSeremban, Negeri Sembilan, Malaysia Working on the latest tech for the Insurtech Market Leader.At CoverGo, our mission is to empower all insurance companies to make insurance 100% digital and accessible to everyone.We are a leading g...Tunjukkan lagiKemas kini terakhir: 17 hari yang lalu
Senior Data Engineer
QuantexaKuala Lumpur, Federal Territory of Kuala Lumpur, MYQuick Apply
- Dinaikkan pangkat
Python and Kubernetes Software Engineer - Data, Workflows, AI / ML & Analytics
CanonicalKampung Baharu Nilai, Malaysia Canonical is a leading provider of open source software and operating systems to the global enterprise and technology markets.
Our platform, Ubuntu, is widely used in breakthrough enterprise initiat...Tunjukkan lagiKemas kini terakhir: 3 hari yang lalu
- Dinaikkan pangkat
- Baharu!
Senior Data Analyst
AirAsiaSepang, Selangor, Malaysia Partner with business and project leaders to deeply understand their goals, define critical metrics and KPIs, and deliver insights that drive action.
Analyze complex datasets to uncover trends, perf...Tunjukkan lagiKemas kini terakhir: 6 jam yang lalu
- Dinaikkan pangkat
- Baharu!
Data Analytics Lead
LearntasticSepang, Sepang, Malaysia About Us : We are a fast-growing continuous education company with multiple brands in the e-learning and certification space.
Our mission is to provide high-quality, accessible courses for profession...Tunjukkan lagiKemas kini terakhir: 6 jam yang lalu