Big Data Hadoop DeveloperUnison Group • Kuala Lumpur, Federal Territory of Kuala Lumpur, MY
Big Data Hadoop Developer
Unison Group • Kuala Lumpur, Federal Territory of Kuala Lumpur, MY
30+ days ago
Job type
- Quick Apply
Job descriptionBig Data Ecosystem : Hadoop (HDFS, YARN), Hive, Spark, Sqoop, MapReduce, Oozie, Flume. Databases : MariaDB and / or Oracle DB (SQL, PL / SQL). Programming : Java, Scala, or Python for Spark / MapReduce development. Data Ingestion : Sqoop, Kafka, Nifi (for integrating RDBMS with Hadoop). Query Optimization : Hive tuning, partitioning, bucketing, indexing. Tools : Ambari, Cloudera Manager, Git, Jenkins. OS & Scripting : Linux / Unix shell scripting. Strong analytical skills and problem-solving abilities. Good communication skills for working with cross-functional teams. Ability to manage priorities in a fast-paced environment. Experience with cloud-based big data platforms (AWS EMR, Azure HDInsight, GCP Dataproc). Knowledge of NoSQL databases (HBase, Cassandra). Exposure to machine learning integration with Hadoop / Spark.
Job Summary :
We are looking for a Big Data Hadoop Developer to design, develop, and maintain large-scale data processing solutions. The ideal candidate should have strong hands-on experience with the Hadoop ecosystem and integration with relational databases such as MariaDB or Oracle DB for analytics and reporting.
Key Responsibilities :
- Design, develop, and optimize Hadoop-based big data solutions for batch and real-time data processing.
- Work with data ingestion frameworks to integrate data from MariaDB / Oracle DB into Hadoop (Sqoop, Apache Nifi, Kafka).
- Implement Hive, Spark, and MapReduce jobs for data transformation and analytics.
- Optimize Hive queries, Spark jobs, and HDFS usage for performance and cost efficiency.
- Create and maintain ETL pipelines for structured and unstructured data.
- Troubleshoot and resolve issues in Hadoop jobs and database connectivity.
- Collaborate with BI, analytics, and data science teams for data provisioning.
- Ensure data security, governance, and compliance in all solutions.
Technical Skills :
Soft Skills :
Nice to Have :
Create a job alert for this search
Developer • Kuala Lumpur, Federal Territory of Kuala Lumpur, MY
Related jobs
Hyperion Planning / Hyperion Essbase / OBIEE.Oracle 11g and 12c / Oracle Essbase and Windows 2008.Language : Experience in PL / SQL , Unix Shell Scripting, Essbase scripting, OBIEE RPD development.Windows...Show more
)
Big Data Developer
Luxoft • Kuala Lumpur, Kuala Lumpur, Malaysia
Our Client a leading bank in Asia with a global network of more than 500 branches and offices in 19 countries and territories in Asia Pacific, Europe, and North America, are looking for Consultants...Show more
Last updated: 13 days ago • Promoted
Lead Data Engineer — Remote & Mentored Big Data
Quantexa • Kajang Municipal Council, Selangor, Malaysia
A leading data analytics firm in Kuala Lumpur is seeking a Lead Data Engineer to guide a team in implementing innovative solutions.
The role involves hands-on programming, mentoring, and collaborati...Show more
Last updated: 8 days ago • Promoted
Big Data Lead — AI-Driven Insights & Tech Leadership
Sunway Digital Hub, Digital Technology Solutions & Group Cybersecurity • Petaling Jaya, Selangor, Malaysia
A technology solutions provider in Petaling Jaya is seeking a Mid-Senior level professional to manage and analyze large datasets to support business decisions.
The role involves designing and develo...Show more
Last updated: 5 days ago • Promoted
Data Architect
Two95 International Inc. • Kuala Lumpur, Kuala Lumpur, Malaysia
Execute Enterprise data initiatives / programs to establish a governed, curated, and agile data ecosystem that enables business to make data-driven decisions.
Translate strategic requirements into a...Show more
Last updated: 30+ days ago • Promoted
Data Visualizer Developer (Experience-Hire)
Accenture Southeast Asia • Kuala Lumpur, Kuala Lumpur, Malaysia
ATCM - Data Visualizer Developer (Entry-Level to Experience-Hire).ATCM - Data Visualizer Developer (Entry-Level to Experience-Hire).
A data visualizer developer who designs and builds interactive da...Show more
Last updated: 30+ days ago • Promoted
Data Scientist - Healthcare
Two95 International Inc. • Kuala Lumpur, Kuala Lumpur, Malaysia
Hiring Local Malaysians only - CONTRACT JOB - 12 MONTHS (EXTENDABLE).DATA SCIENTIST - IT with Extensive experience in "Healthcare ".
With Minimum Experience - 5 years & Maximum Experience - 15 years...Show more
Last updated: 30+ days ago • Promoted
Data Architect - D1
Capgemini • Kuala Lumpur, Kuala Lumpur, Malaysia
Capgemini Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia.Data Architects drive change that creates business opportunity through data‑driven insights.
Architects shape and translate busine...Show more
Last updated: 30+ days ago • Promoted
Big Data Engineer : Hadoop, Teradata & Python
Luxoft • Kuala Lumpur, Kuala Lumpur, Malaysia
A leading bank in Asia is seeking Data Engineers to join their new technology center in Kuala Lumpur.You will be responsible for designing data pipelines and ETL workflows, working with big data te...Show more
Last updated: 8 days ago • Promoted
Datawarehouse developer senior
New Era Technology • Petaling Jaya, Selangor, Malaysia
Join New Era Technology, where People Firstis at the heart of everything we do.With a global team of over 4,500 professionals, we’re committed to creating a workplace where everyone feels valued, e...Show more
Last updated: 14 days ago • Promoted
Developer - Hyperion Essbase / OBIEE
Two95 International Inc. • kuala lumpur, Federal Territory of Kuala Lumpur, MY
Quick Apply
Last updated: 30+ days ago
Senior Software Engineer (Big Data)
EPAM Systems • Kuala Lumpur, Kuala Lumpur, Malaysia
EPAM Systems Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia.Software Engineers at EPAM are the driving force behind strategic initiatives for our clients.
EPAM Malaysia, you will use your...Show more
Last updated: 30+ days ago • Promoted
Head, Data Analytics
AFFIN Group • Kuala Lumpur, Kuala Lumpur, Malaysia
Create the future with Affin! You too can make a difference.We continuously innovate to transform our financial services landscape - making banking better and easier.
Join us at AFFIN, where the ope...Show more
Last updated: 27 days ago • Promoted
65097 Data Architect
half the sky • Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia
Responsible for data lake design and providing technical direction to data engineer, data analysts, data integration developers and database administrators.
Provide input, monitor, and coordinate th...Show more
Last updated: 30+ days ago • Promoted
Developer - Hadoop, Teradata, Python
Luxoft • Kuala Lumpur, Kuala Lumpur, Malaysia
Our Client a leading bank in Asia with a global network of more than 500 branches and offices in 19 countries and territories in Asia Pacific, Europe, and North America, are looking for Consultants...Show more
Last updated: 30+ days ago • Promoted
AVP, Data Integration (pySpark, Nifi, Hadoop)
Maybank • Kuala LumpurMalaysia, Kuala Lumpur, Malaysia
AVP, Data Integration (pySpark, Nifi, Hadoop).Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia.Get AI-powered advice on this job and more exclusive features.
Implement ETL systems that are ...Show more
Last updated: 30+ days ago • Promoted
Data Developer
RiDiK (a Subsidiary of CLPS. Nasdaq : CLPS) • Kuala Lumpur, Kuala Lumpur, Malaysia
Be among the first 25 applicants.Direct message the job poster from RiDiK (a subsidiary of CLPS, Nasdaq : CLPS).Aspiring IT Recruiter | Passionate About Connecting Tech Talent.Data Developer / Data ...Show more
Last updated: 6 days ago • Promoted
Data Architect
Capgemini • Kuala Lumpur, Kuala Lumpur, Malaysia
Explore our latest thought leadership, ideas, and insights on the issues that are shaping the future of business and society.
Choose a partner with intimate knowledge of your industry and first-hand...Show more
Last updated: 30+ days ago • Promoted
Data Developer
The Access Group • Kuala Lumpur, Kuala Lumpur, Malaysia
Data Developer page is loaded## Data Developerremote type : Hybridlocations : Kuala Lumpur - GOCtime type : Full timeposted on : Posted Todayjob requisition id : JR We’re looking for people to...Show more
Last updated: 30+ days ago • Promoted