This job offer is not available in your country.
Big Data Hadoop Developer
Unison GroupKuala Lumpur, Federal Territory of Kuala Lumpur, MY17 days ago
Job type
- Quick Apply
Job descriptionBig Data Ecosystem : Hadoop (HDFS, YARN), Hive, Spark, Sqoop, MapReduce, Oozie, Flume. Databases : MariaDB and / or Oracle DB (SQL, PL / SQL). Programming : Java, Scala, or Python for Spark / MapReduce development. Data Ingestion : Sqoop, Kafka, Nifi (for integrating RDBMS with Hadoop). Query Optimization : Hive tuning, partitioning, bucketing, indexing. Tools : Ambari, Cloudera Manager, Git, Jenkins. OS & Scripting : Linux / Unix shell scripting. Strong analytical skills and problem-solving abilities. Good communication skills for working with cross-functional teams. Ability to manage priorities in a fast-paced environment. Experience with cloud-based big data platforms (AWS EMR, Azure HDInsight, GCP Dataproc). Knowledge of NoSQL databases (HBase, Cassandra). Exposure to machine learning integration with Hadoop / Spark.
Job Summary :
We are looking for a Big Data Hadoop Developer to design, develop, and maintain large-scale data processing solutions. The ideal candidate should have strong hands-on experience with the Hadoop ecosystem and integration with relational databases such as MariaDB or Oracle DB for analytics and reporting.
Key Responsibilities :
- Design, develop, and optimize Hadoop-based big data solutions for batch and real-time data processing.
- Work with data ingestion frameworks to integrate data from MariaDB / Oracle DB into Hadoop (Sqoop, Apache Nifi, Kafka).
- Implement Hive, Spark, and MapReduce jobs for data transformation and analytics.
- Optimize Hive queries, Spark jobs, and HDFS usage for performance and cost efficiency.
- Create and maintain ETL pipelines for structured and unstructured data.
- Troubleshoot and resolve issues in Hadoop jobs and database connectivity.
- Collaborate with BI, analytics, and data science teams for data provisioning.
- Ensure data security, governance, and compliance in all solutions.
Technical Skills :
Soft Skills :
Nice to Have :
Create a job alert for this search
Developer • Kuala Lumpur, Federal Territory of Kuala Lumpur, MY
Related jobs
- Promoted
Technical Marketing Engineer
Infotree Global SolutionsSeremban, Negeri Sembilan, Malaysia Job title : Developer : Technical Marketing - III.Max salary budget : RM8,000 / month.Experience : 5+ years in technical roles, 2+ years with developers, coding skills, and hands-on AI / edge / IoT experienc...Show moreLast updated: 15 days ago
- Promoted
Senior.NET Developer
EcoVadisSeremban, Negeri Sembilan, Malaysia Work smart, have fun and make an impact!.Our purpose is to guide all companies toward a sustainable world.EcoVadis is the leading provider of business sustainability ratings.Our solutions are backe...Show moreLast updated: 17 days ago
- Promoted
- New!
Senior Specialist Digital Workplace
DKSH Scientific SolutionsSelayang Municipal Council, Selayang Municipal Council, Malaysia Senior Specialist Digital Workplace – Kuala Lumpur, Malaysia.Job Function : Information Technology.Build, run and maintain digital workplace solutions.
Strong in identity management solutions with Ac...Show moreLast updated: 6 hours ago
- Promoted
- New!
Manager, Analytics (Senior Data Scientist)
Hong Leong Bank BerhadKuala Lumpur, Kuala Lumpur, Malaysia The Senior Data Scientist / Manager, Analytics leads advanced analytics projects for the Consumer and Business Banking units to drive tangible business outcomes such as increased sales, revenue, and ...Show moreLast updated: 12 hours ago
- Promoted
- New!
Freelance Developer Consultant (Kotlin) - AI Trainer
MindriftKuala Selangor, Kuala Selangor, Malaysia Freelance Developer Consultant (Kotlin) - AI Trainer.This opportunity is a remote freelance role with Mindrift, focused on evolving GenAI models and contributing as an AI Tutor in Coding.Applicants...Show moreLast updated: 6 hours ago
- Promoted
- New!
Unity Developer
AvatarisSeremban, Negeri Sembilan, Malaysia Avataris ( creates photorealistic AI avatars that enhance customer interactions across websites, apps, and digital platforms.
We are a remote-first team of AI, Unity, and avatar experts shaping the ...Show moreLast updated: 6 hours ago
- Promoted
Solutions Architect (Insurance) - Fully Remote
CoverGo | InsurtechPort Klang, Port Klang, Malaysia Working on the latest tech for the Insurtech Market Leader.At CoverGo, our mission is to empower all insurance companies to make insurance 100% digital and accessible to everyone.We are a leading g...Show moreLast updated: 17 days ago
- Promoted
Senior Paid Media Buyer
NavigatorPort Klang, Port Klang, Malaysia Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia.Fresh off our Series A, we’re entering a new growth chapter building on the incredibly strong foundations to date.We are looking for an exp...Show moreLast updated: 10 days ago
- Promoted
- New!
Freelance AI Solutions Engineer - Generative AI & Data Workflows
MindriftSelayang Municipal Council, Selayang Municipal Council, Malaysia Freelance AI Solutions Engineer - Generative AI & Data Workflows.Be among the first 25 applicants.This opportunity is only for candidates currently residing in the specified country.Your location m...Show moreLast updated: 6 hours ago
- Promoted
- New!
Manager, Data Privacy
CGC MalaysiaPetaling Jaya, Selangor, Malaysia Support the Data Protection Officer (DPO) in developing, implementing and maintaining effective internal data privacy policies and procedures in alignment with data protection requirements.Monitor ...Show moreLast updated: 6 hours ago
- Promoted
- New!
Data Analytics Lead
LearntasticSelayang Municipal Council, Selayang Municipal Council, Malaysia About Us : We are a fast-growing continuous education company with multiple brands in the e-learning and certification space.
Our mission is to provide high-quality, accessible courses for profession...Show moreLast updated: 6 hours ago
- Promoted
- New!
Account Executive
ECOS LINK SOLUTIONS SDN BHDSelayang Municipal Council, Selayang Municipal Council, Malaysia Get AI-powered advice on this job and more exclusive features.Direct message the job poster from ECOS LINK SOLUTIONS SDN BHD.
Chief Operating Officer in Ecos Link Solutions.To manage the day-to-day ...Show moreLast updated: 12 hours ago
- Promoted
Deployment Engineer- MY (Big Data / Hadoop Admin)
Tookitaki Holding PTE LTDKuala Lumpur, Kuala Lumpur, Malaysia Job Title : Deployment Engineer | Department : Services Delivery | Reporting To : Regional Head of Service Delivery.The Deployment Engineer is a critical technical role within Tookitaki’s Services Del...Show moreLast updated: 26 days ago
- Promoted
- New!
EMEA Senior Enterprise Sales Executive
7SIGNALSeremban, Negeri Sembilan, Malaysia We’re looking for a dynamic and experienced.Senior Enterprise Sales Executive.SaaS solutions to customers in.Manufacturing, Distribution, Healthcare, and Retail.
The ideal candidate will bring 7+ ye...Show moreLast updated: 6 hours ago
- Promoted
- New!
Senior Conversion Optimization Analyst (Remote)
XsollaKlang City, Selangor, Malaysia At Xsolla, we believe that great games begin as ideas, driven by the curiosity, dedication, and grit of creators around the world.
Our mission is to empower these visionaries by providing the suppor...Show moreLast updated: 6 hours ago
- Promoted
- New!
Senior Statistician
OPISKuala Selangor, Kuala Selangor, Malaysia Due to our ongoing global expansion, we have a great opportunity for a.The Senior Statistician reports to the Biostatistics Coordinator, serves as the primary point of contact to the study team for...Show moreLast updated: 6 hours ago
- Promoted
- New!
Nearshore - Frontend Developer Consultant
BitoviPort Klang, Port Klang, Malaysia IMPORTANT TO NOTE : This job post is for a full-time, remote contractor role.It is focused on candidates from LATAM and other nearshore locations who can commit to working a minimum of 6 hours durin...Show moreLast updated: 6 hours ago
- Promoted
Senior Business Analyst - Insurance, Cantonese Speaker (Fully Remote)
CoverGoSeremban, Negeri Sembilan, Malaysia Working on the latest tech for the Insurtech Market Leader.At CoverGo, our mission is to empower all insurance companies to make insurance 100% digital and accessible to everyone.We are a leading g...Show moreLast updated: 17 days ago