Big Data Hadoop Developer
Unison Consulting Pte LtdKuala Lumpur, Kuala Lumpur, Malaysia30+ hari lalu
Penerangan pekerjaanBig Data Ecosystem : Hadoop (HDFS, YARN), Hive, Spark, Sqoop, MapReduce, Oozie, Flume. Databases : MariaDB and / or Oracle DB (SQL, PL / SQL). Programming : Java, Scala, or Python for Spark / MapReduce development. Data Ingestion : Sqoop, Kafka, Nifi (for integrating RDBMS with Hadoop). Query Optimization : Hive tuning, partitioning, bucketing, indexing. Tools : Ambari, Cloudera Manager, Git, Jenkins. OS & Scripting : Linux / Unix shell scripting. Strong analytical skills and problem-solving abilities. Good communication skills for working with cross-functional teams. Ability to manage priorities in a fast-paced environment. Experience with cloud-based big data platforms (AWS EMR, Azure HDInsight, GCP Dataproc). Knowledge of NoSQL databases (HBase, Cassandra). Exposure to machine learning integration with Hadoop / Spark.
Job Summary :
We are looking for a Big Data Hadoop Developer to design, develop, and maintain large-scale data processing solutions. The ideal candidate should have strong hands-on experience with the Hadoop ecosystem and integration with relational databases such as MariaDB or Oracle DB for analytics and reporting.
Key Responsibilities :
- Design, develop, and optimize Hadoop-based big data solutions for batch and real-time data processing.
- Work with data ingestion frameworks to integrate data from MariaDB / Oracle DB into Hadoop (Sqoop, Apache Nifi, Kafka).
- Implement Hive, Spark, and MapReduce jobs for data transformation and analytics.
- Optimize Hive queries, Spark jobs, and HDFS usage for performance and cost efficiency.
- Create and maintain ETL pipelines for structured and unstructured data.
- Troubleshoot and resolve issues in Hadoop jobs and database connectivity.
- Collaborate with BI, analytics, and data science teams for data provisioning.
- Ensure data security, governance, and compliance in all solutions.
Technical Skills :
Soft Skills :
Nice to Have :
#J-18808-Ljbffr
Buat amaran kerja untuk carian ini
Big Data Hadoop Developer • Kuala Lumpur, Kuala Lumpur, Malaysia
Pekerjaan berkaitan
)
)
- Dinaikkan pangkat
Lead Software Engineer (Big Data)
EPAM SystemsKuala Lumpur, Kuala Lumpur, Malaysia EPAM Systems is seeking a highly skilled and motivated.Big Data, Machine Learning Operations, and scalable enterprise software development.
Join our dynamic team and take the lead in designing and i...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu
- Dinaikkan pangkat
Data Visualizer Developer (Experience-Hire)
Accenture Southeast AsiaKuala Lumpur, Kuala Lumpur, Malaysia ATCM - Data Visualizer Developer (Entry-Level to Experience-Hire).ATCM - Data Visualizer Developer (Entry-Level to Experience-Hire).
A data visualizer developer who designs and builds interactive da...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu
- Dinaikkan pangkat
Data Architect
Two95 International Inc.Kuala Lumpur, Kuala Lumpur, Malaysia Execute Enterprise data initiatives / programs to establish a governed, curated, and agile data ecosystem that enables business to make data-driven decisions.
Translate strategic requirements into a...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu
- Dinaikkan pangkat
Senior QA Engineer - Data Lake
PayNet (Payments Network Malaysia)Kuala Lumpur, Kuala Lumpur, Malaysia Get AI-powered advice on this job and more exclusive features.Direct message the job poster from PayNet (Payments Network Malaysia).
As a QA Engineer, you will play a critical role in designing, dev...Tunjukkan lagiKemas kini terakhir: 19 hari yang lalu
- Dinaikkan pangkat
Data Scientist II
Asia Digital Engineering (ADE)Sepang, Selangor, Malaysia Asia Digital Engineering (ADE) is transforming aircraft maintenance through data and innovation.As a wholly-owned subsidiary of Capital A Berhad, we're building the future of MRO by combining AirAs...Tunjukkan lagiKemas kini terakhir: 22 hari yang lalu
- Dinaikkan pangkat
Head of Global Common Operations
NexperiaSeremban, Negeri Sembilan, Malaysia Head of Global Common Operations page is loaded## Head of Global Common Operationslocations : Serembanposted on : Posted Todayjob requisition id : R- • •About the job • •The Head of IT Global Commo...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu
Lead / Senior Data Engineer
Capcon AsiaKuala Lumpur, Malaysia Regulated and trusted by financial institutions globally.Pioneers in mobile point-of-sale (mPOS) solutions focusing on low-cost acceptance payment.
Secured US$30M Series B funding.Rapid growth : scal...Tunjukkan lagiKemas kini terakhir: 16 hari yang lalu
- Dinaikkan pangkat
Developer - Hadoop, Teradata, Python
LuxoftKuala Lumpur, Kuala Lumpur, Malaysia Our Client a leading bank in Asia with a global network of more than 500 branches and offices in 19 countries and territories in Asia Pacific, Europe, and North America, are looking for Consultants...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu
- Dinaikkan pangkat
Quantitative Developer (US Stock Market / Crypto), KL Based
Links InternationalKuala Lumpur, Kuala Lumpur, Malaysia Senior Recruitment Consultant | Talent Advisor | Technology, Digital, Sales & Marketing.Design and develop ultra-low latency trading systems in.
US equities and cryptocurrency markets.Implement effi...Tunjukkan lagiKemas kini terakhir: 9 hari yang lalu
- Dinaikkan pangkat
Oracle Developer (remote)
PEOPLE PROFILERSKuala Selangor, Kuala Selangor, Malaysia Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia.Job Description : Job Ref : QY7VW585.People Profilers is hiring on behalf of a global tire company, fully integrated across R&D, manufacturing...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu
- Dinaikkan pangkat
AVP, Data Integration (pySpark, Nifi, Hadoop)
MaybankKuala LumpurMalaysia, Kuala Lumpur, Malaysia AVP, Data Integration (pySpark, Nifi, Hadoop).Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia.Get AI-powered advice on this job and more exclusive features.
Implement ETL systems that are ...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu
- Dinaikkan pangkat
Senior Java Developer
Cultivar Staffing & SearchKlang City, Selangor, Malaysia Our client is a tech start-up from China, and its regional office in Singapore is hiring remote engineers and technicians to support their projects.
Design, develop, and optimize back-end systems fo...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu
- Dinaikkan pangkat
Senior Product Manager - AI AdOps Copilot (REMOTE)
MonetizeMoreSeremban, Negeri Sembilan, Malaysia Senior Product Manager - AI AdOps Copilot (REMOTE).MonetizeMore is a global leader in ad tech, providing solutions that help publishers maximize their ad revenue while maintaining transparency, use...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu
- Dinaikkan pangkat
Utilities Engineer
LonzaSemenyih, Selangor, Malaysia Today, Lonza is a global leader in life sciences operating across five continents.While we work in science, there’s no magic formula to how we do it.
Our greatest scientific solution is dedicated in...Tunjukkan lagiKemas kini terakhir: 15 hari yang lalu
- Dinaikkan pangkat
Senior Web Developer (Remote)
RemotelyKuala Selangor, Kuala Selangor, Malaysia We are currently searching for a Senior Web Engineer to join us and work as part of an enthusiastic, motivated, and delivery focused agile team.
You will have the opportunity to work on all aspects ...Tunjukkan lagiKemas kini terakhir: 2 hari yang lalu
- Dinaikkan pangkat
Data Partner - Business Writer (Thai)
TELUS Digital AI Data SolutionsSeremban, Negeri Sembilan, Malaysia Are you ready to use your domain knowledge to advance AI? Join us as a.We are seeking a highly knowledgeable Subject Matter Expert to design advanced, domain‑specific questions and solutions.The ro...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu
- Dinaikkan pangkat
Data Developer
The Access GroupKuala Lumpur, Kuala Lumpur, Malaysia Data Developer page is loaded## Data Developerremote type : Hybridlocations : Kuala Lumpur - GOCtime type : Full timeposted on : Posted Todayjob requisition id : JR We’re looking for people to...Tunjukkan lagiKemas kini terakhir: 16 hari yang lalu
- Dinaikkan pangkat
Data Architect
CapgeminiKuala Lumpur, Kuala Lumpur, Malaysia Explore our latest thought leadership, ideas, and insights on the issues that are shaping the future of business and society.
Choose a partner with intimate knowledge of your industry and first-hand...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu