Talent.com
Big Data Hadoop Developer
Big Data Hadoop DeveloperUnison Group • Kuala Lumpur, Federal Territory of Kuala Lumpur, MY
Big Data Hadoop Developer

Big Data Hadoop Developer

Unison Group • Kuala Lumpur, Federal Territory of Kuala Lumpur, MY
30+ hari lalu
Jenis pekerjaan
  • Quick Apply
Penerangan pekerjaan

Job Summary :

We are looking for a Big Data Hadoop Developer to design, develop, and maintain large-scale data processing solutions. The ideal candidate should have strong hands-on experience with the Hadoop ecosystem and integration with relational databases such as MariaDB or Oracle DB for analytics and reporting.

Key Responsibilities :

  • Design, develop, and optimize Hadoop-based big data solutions for batch and real-time data processing.
  • Work with data ingestion frameworks to integrate data from MariaDB / Oracle DB into Hadoop (Sqoop, Apache Nifi, Kafka).
  • Implement Hive, Spark, and MapReduce jobs for data transformation and analytics.
  • Optimize Hive queries, Spark jobs, and HDFS usage for performance and cost efficiency.
  • Create and maintain ETL pipelines for structured and unstructured data.
  • Troubleshoot and resolve issues in Hadoop jobs and database connectivity.
  • Collaborate with BI, analytics, and data science teams for data provisioning.
  • Ensure data security, governance, and compliance in all solutions.

Technical Skills :

  • Big Data Ecosystem : Hadoop (HDFS, YARN), Hive, Spark, Sqoop, MapReduce, Oozie, Flume.
  • Databases : MariaDB and / or Oracle DB (SQL, PL / SQL).
  • Programming : Java, Scala, or Python for Spark / MapReduce development.
  • Data Ingestion : Sqoop, Kafka, Nifi (for integrating RDBMS with Hadoop).
  • Query Optimization : Hive tuning, partitioning, bucketing, indexing.
  • Tools : Ambari, Cloudera Manager, Git, Jenkins.
  • OS & Scripting : Linux / Unix shell scripting.

    • Soft Skills :

  • Strong analytical skills and problem-solving abilities.
  • Good communication skills for working with cross-functional teams.
  • Ability to manage priorities in a fast-paced environment.

    • Nice to Have :

  • Experience with cloud-based big data platforms (AWS EMR, Azure HDInsight, GCP Dataproc).
  • Knowledge of NoSQL databases (HBase, Cassandra).
  • Exposure to machine learning integration with Hadoop / Spark.
    • Buat amaran kerja untuk carian ini

    Developer • Kuala Lumpur, Federal Territory of Kuala Lumpur, MY

    Pekerjaan berkaitan
    Lead Engineer

    Lead Engineer

    Soft Space Sdn Bhd • Seremban, Negeri Sembilan, Malaysia
    We are seeking a technically strong leader based in Malaysia to head our North America region projects.The Lead Engineer will take ownership of regional delivery, technical solutioning, and team le...Tunjukkan lagi
    Kemas kini terakhir: 19 hari yang lalu • Dinaikkan pangkat
    Senior AI Full-Stack Developer - Python / React

    Senior AI Full-Stack Developer - Python / React

    OneSeven Tech (OST) • Klang City, Selangor, Malaysia
    OneSeven Tech (OST) is seeking a Senior Full-Stack Engineer to join our team.We are looking for someone who focuses on building and deploying full-scale applications while leveraging cutting-edge A...Tunjukkan lagi
    Kemas kini terakhir: 30+ hari yang lalu • Dinaikkan pangkat
    Senior Business Analyst - Health Insurance (Fully Remote)

    Senior Business Analyst - Health Insurance (Fully Remote)

    CoverGo | Insurtech • Port Klang, Port Klang, Malaysia
    Senior Business Analyst - Health Insurance (Fully Remote).Senior Business Analyst - Health Insurance (Fully Remote).Working on the latest tech for the Insurtech Market Leader.Working on the latest ...Tunjukkan lagi
    Kemas kini terakhir: 30+ hari yang lalu • Dinaikkan pangkat
    Senior Sales Engineer

    Senior Sales Engineer

    Sophos • Seremban, Negeri Sembilan, Malaysia
    Sophos is a global leader and innovator of advanced security solutions designed to defeat cyberattacks.The company acquired Secureworks in February 2025, creating the largest pure‑play Managed Dete...Tunjukkan lagi
    Kemas kini terakhir: 8 hari yang lalu • Dinaikkan pangkat
    Head of Global Supply Chain (eCommerce)

    Head of Global Supply Chain (eCommerce)

    Crafti • Sepang, Sepang, Malaysia
    Remote (based in Malaysia) | Full-time | 10,000 - 15,000 MYR / month.We’re looking for an experienced Head of Global Supply Chain (eCommerce) to own and optimise our multi‑country supply chain operat...Tunjukkan lagi
    Kemas kini terakhir: 4 hari yang lalu • Dinaikkan pangkat
    Senior / Staff / Principal Engineer

    Senior / Staff / Principal Engineer

    Canonical • Sepang, Selangor, Malaysia
    Canonical Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia.Join or sign in to find your next job.Senior / Staff / Principal Engineer. Canonical Kuala Lumpur, Federal Territory of Kuala Lumpur, ...Tunjukkan lagi
    Kemas kini terakhir: 30+ hari yang lalu • Dinaikkan pangkat
    Lead / Senior Data Engineer

    Lead / Senior Data Engineer

    Capcon Asia • Kuala Lumpur, Malaysia
    Quick Apply
    Regulated and trusted by financial institutions globally.Pioneers in mobile point-of-sale (mPOS) solutions focusing on low-cost acceptance payment. Secured US$30M Series B funding.Rapid growth : scal...Tunjukkan lagi
    Kemas kini terakhir: 22 hari yang lalu
    Data Engineer

    Data Engineer

    2COMS Consulting Pvt Ltd • Puchong, Selangor, Malaysia
    Quick Apply
    Candidates should be based in Malaysia.What is this role all about? What does the applicant have to do?).Develop and maintain data models (customer 360, product, network, usage).Work with data lake...Tunjukkan lagi
    Kemas kini terakhir: 13 jam yang lalu • Baharu!
    Senior Data Engineer

    Senior Data Engineer

    ZALORA SOUTH EAST ASIA PTE LTD • Kuala Lumpur, Kuala Lumpur, MY
    Quick Apply
    ZALORA Group is looking for a Senior Data Engineer to join its Data Science Team.As a Senior Data Engineer, you will : Work daily with machine learning problems.For this purpose, y...Tunjukkan lagi
    Kemas kini terakhir: 30+ hari yang lalu
    Senior.NET Developer

    Senior.NET Developer

    EcoVadis • Klang City, Selangor, Malaysia
    Work smart, have fun and make an impact!.Our purpose is to guide all companies toward a sustainable world.EcoVadis is the leading provider of business sustainability ratings.Our solutions are backe...Tunjukkan lagi
    Kemas kini terakhir: 30+ hari yang lalu • Dinaikkan pangkat
    Developer - Hyperion Essbase / OBIEE

    Developer - Hyperion Essbase / OBIEE

    Two95 International Inc. • kuala lumpur, Federal Territory of Kuala Lumpur, MY
    Quick Apply
    Hyperion Planning / Hyperion Essbase / OBIEE.Oracle 11g and 12c / Oracle Essbase and Windows 2008.Language : Experience in PL / SQL , Unix Shell Scripting, Essbase scripting, OBIEE RPD development.Windows...Tunjukkan lagi
    Kemas kini terakhir: 30+ hari yang lalu
    Senior Web Engineer

    Senior Web Engineer

    Canonical • Nilai, Negeri Sembilan, Malaysia
    Canonical Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia.Join or sign in to find your next job.Canonical Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia.Be among the first 25 a...Tunjukkan lagi
    Kemas kini terakhir: 30+ hari yang lalu • Dinaikkan pangkat
    Data Architect

    Data Architect

    Two95 International Inc. • Kuala Lumpur, Federal Territory of Kuala Lumpur, MY
    Quick Apply
    Execute Enterprise data initiatives / programs to establish a governed, curated, and agile data ecosystem that enables business to make data-driven decisions. Translate strategic requirements in...Tunjukkan lagi
    Kemas kini terakhir: 30+ hari yang lalu
    Regional Data & Analytics Head

    Regional Data & Analytics Head

    SCIENTE • Kuala Lumpur, Kuala Lumpur, Malaysia
    Director - Global Talent Acquisition (Services & Projects).Lead the regional Data & AI strategy, governance, and delivery to drive innovation, compliance, and measurable business impact.Define and ...Tunjukkan lagi
    Kemas kini terakhir: 8 hari yang lalu • Dinaikkan pangkat
    Data Associate

    Data Associate

    Always Marketing Malaysia Sdn Bhd • KL Gateway, Kuala Lumpur, MY
    Quick Apply
    Overview Do you like to consistently pay attention to the finest details, and spend the workday using a computer platform rather than interacting with people?. If you are an experienced Machine Lear...Tunjukkan lagi
    Kemas kini terakhir: 26 hari yang lalu
    Senior Data Scientist

    Senior Data Scientist

    Two95 International Inc. • Kuala Lumpur, Federal Territory of Kuala Lumpur, MY
    Quick Apply
    As a Senior Data Scientist you will conceptualize, develop and execute statistical, mathematical and econometric models for business decision making, risk assessment and strategic initiatives.You w...Tunjukkan lagi
    Kemas kini terakhir: 30+ hari yang lalu
    Senior Manager, Finance (Relocate to Poland)

    Senior Manager, Finance (Relocate to Poland)

    YSQ International • Klang City, Selangor, Malaysia
    Senior Manager, Finance (Relocate to Poland).The incumbent is responsible for overseeing the full spectrum of finance and accounting functions related to factory and product costing for the HQ Comp...Tunjukkan lagi
    Kemas kini terakhir: 1 hari yang lalu • Dinaikkan pangkat
    Mobile Developer Hiring Immediately

    Mobile Developer Hiring Immediately

    Two95 International Inc. • Mont Kiara, Federal Territory of Kuala Lumpur, MY
    Quick Apply
    Develop and maintain both cross-platform mobile solution for IOS or Android.Contribute in concept, design, build, test, release and application support. Stay up-to-date with new mobile ...Tunjukkan lagi
    Kemas kini terakhir: 30+ hari yang lalu