Big Data Hadoop DeveloperUnison Group • Kuala Lumpur, Federal Territory of Kuala Lumpur, MY

Big Data Hadoop Developer

Unison Group • Kuala Lumpur, Federal Territory of Kuala Lumpur, MY

30+ days ago

Job type

Quick Apply

Job description

Job Summary :

We are looking for a Big Data Hadoop Developer to design, develop, and maintain large-scale data processing solutions. The ideal candidate should have strong hands-on experience with the Hadoop ecosystem and integration with relational databases such as MariaDB or Oracle DB for analytics and reporting.

Key Responsibilities :

Design, develop, and optimize Hadoop-based big data solutions for batch and real-time data processing.
Work with data ingestion frameworks to integrate data from MariaDB / Oracle DB into Hadoop (Sqoop, Apache Nifi, Kafka).
Implement Hive, Spark, and MapReduce jobs for data transformation and analytics.
Optimize Hive queries, Spark jobs, and HDFS usage for performance and cost efficiency.
Create and maintain ETL pipelines for structured and unstructured data.
Troubleshoot and resolve issues in Hadoop jobs and database connectivity.
Collaborate with BI, analytics, and data science teams for data provisioning.
Ensure data security, governance, and compliance in all solutions.

Technical Skills :

Big Data Ecosystem : Hadoop (HDFS, YARN), Hive, Spark, Sqoop, MapReduce, Oozie, Flume.

Databases : MariaDB and / or Oracle DB (SQL, PL / SQL).

Programming : Java, Scala, or Python for Spark / MapReduce development.

Data Ingestion : Sqoop, Kafka, Nifi (for integrating RDBMS with Hadoop).

Query Optimization : Hive tuning, partitioning, bucketing, indexing.

Tools : Ambari, Cloudera Manager, Git, Jenkins.

OS & Scripting : Linux / Unix shell scripting.

Soft Skills :

Strong analytical skills and problem-solving abilities.

Good communication skills for working with cross-functional teams.

Ability to manage priorities in a fast-paced environment.

Nice to Have :

Experience with cloud-based big data platforms (AWS EMR, Azure HDInsight, GCP Dataproc).

Knowledge of NoSQL databases (HBase, Cassandra).

Exposure to machine learning integration with Hadoop / Spark.

Create a job alert for this search

Developer • Kuala Lumpur, Federal Territory of Kuala Lumpur, MY

Related jobs

Lead Engineer

Soft Space Sdn Bhd • Seremban, Negeri Sembilan, Malaysia

We are seeking a technically strong leader based in Malaysia to head our North America region projects.The Lead Engineer will take ownership of regional delivery, technical solutioning, and team le...Show more

Last updated: 18 days ago • Promoted

Senior Sales Engineer

Sophos • Seremban, Negeri Sembilan, Malaysia

Sophos is a global leader and innovator of advanced security solutions designed to defeat cyberattacks.The company acquired Secureworks in February 2025, creating the largest pure‑play Managed Dete...Show more

Last updated: 7 days ago • Promoted

Senior / Staff / Principal Engineer

Canonical • Sepang, Selangor, Malaysia

Canonical Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia.Join or sign in to find your next job.Senior / Staff / Principal Engineer. Canonical Kuala Lumpur, Federal Territory of Kuala Lumpur, ...Show more

Last updated: 30+ days ago • Promoted

Medical Claims Assessors, Officer / Senior Officer (VHIS, Remote / Hybrid)

Bowtie Life Insurance Company Limited • Selayang Municipal Council, Selayang Municipal Council, Malaysia

Bowtie’s mission is to make insurance good again and our vision is to build a category-defining health insurance company. As a young and fast-growing company, grooming and learning from the next gen...Show more

Last updated: 30+ days ago • Promoted

Data & Finance Support Engineer

Sperton Global AS • Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia

Provide application support to various business users.Attend to business queries and business requests promptly.Follow through the business requests to a proper closure. Work on timely resolution fo...Show more

Last updated: 30+ days ago • Promoted

Senior Finance Executive

Talent Recruit • Jenjarom, Selangor, Malaysia

We are representing our client who is in the steel manufacturing industry.As part of our client's ongoing ERP system implementation, they are seeking a. Prepare, record, and process daily financial ...Show more

Last updated: 30+ days ago • Promoted

Lead / Senior Data Engineer

Capcon Asia • Kuala Lumpur, Malaysia

Quick Apply

Regulated and trusted by financial institutions globally.Pioneers in mobile point-of-sale (mPOS) solutions focusing on low-cost acceptance payment. Secured US$30M Series B funding.Rapid growth : scal...Show more

Last updated: 21 days ago

Developer - Hyperion Essbase / OBIEE

Two95 International Inc. • kuala lumpur, Federal Territory of Kuala Lumpur, MY

Quick Apply

Hyperion Planning / Hyperion Essbase / OBIEE.Oracle 11g and 12c / Oracle Essbase and Windows 2008.Language : Experience in PL / SQL , Unix Shell Scripting, Essbase scripting, OBIEE RPD development.Windows...Show more

Last updated: 30+ days ago

Senior Web Engineer

Canonical • Nilai, Negeri Sembilan, Malaysia

Canonical Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia.Join or sign in to find your next job.Canonical Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia.Be among the first 25 a...Show more

Last updated: 30+ days ago • Promoted

Data Engineer

Link Compliance • Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia

My client is one of the leading digital banks in Malaysia.Design, develop, and maintain reliable and scalable data pipelines using Apache Airflow. Implement data ingestion, transformation, and valid...Show more

Last updated: 30+ days ago • Promoted

Senior Fullstack Developer

Hyred • Kuala Lumpur, Malaysia

The Senior Full Stack Developer is responsible for designing, developing, and maintaining high-quality web applications across the full technology stack. This role requires strong technical expertis...Show more

Last updated: 30+ days ago • Promoted

65097 Data Architect

half the sky • Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia

Responsible for data lake design and providing technical direction to data engineer, data analysts, data integration developers and database administrators. Provide input, monitor, and coordinate th...Show more

Last updated: 30+ days ago • Promoted

WD30192620 Senior Financial Analyst

half the sky • Klang, Selangor, Malaysia

Assist and backup Finance controller.Responsibilities include consolidations, annual planning and monthly P&L, free cash flow forecasts / outlook as well as financial reporting (closing task).Work wi...Show more

Last updated: 30+ days ago • Promoted

Associate Director

Newbridge • Kuala Selangor, Selangor, Malaysia

Oversee the accuracy and timeliness of financial reports and forecasts, ensuring alignment with business objectives.Identify trends, analyze variances, and develop improvement plans to optimize fin...Show more

Last updated: 30+ days ago • Promoted

IT ADMINISTRATOR

Iswanah Resources Sdn Bhd • Batu Caves, Selangor, Malaysia

Diploma in Computer Science, Information Technology or a related field.IT Admininstrator, Network Administrator or similar role. Strong Understanding of TCP / IP, DNS, DHCP, VPN, Firewalls, and routin...Show more

Last updated: 30+ days ago • Promoted

Regional Data & Analytics Head

SCIENTE • Kuala Lumpur, Kuala Lumpur, Malaysia

Director - Global Talent Acquisition (Services & Projects).Lead the regional Data & AI strategy, governance, and delivery to drive innovation, compliance, and measurable business impact.Define and ...Show more

Last updated: 7 days ago • Promoted

64995 Data Modeler

half the sky • Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia

Avanade is the leading provider of innovative digital, cloud and advisory services, industry solutions and design-led experiences across the Microsoft ecosystem. Every day, our 59,000 professionals ...Show more

Last updated: 30+ days ago • Promoted

Senior Manager, Finance (Relocate to Poland)

YSQ International • Klang City, Selangor, Malaysia

Senior Manager, Finance (Relocate to Poland).The incumbent is responsible for overseeing the full spectrum of finance and accounting functions related to factory and product costing for the HQ Comp...Show more

Last updated: 19 hours ago • Promoted • New!