Big Data Hadoop Developer
Unison GroupKuala Lumpur, Federal Territory of Kuala Lumpur, MY30+ hari lalu
Jenis pekerjaan
- Quick Apply
Penerangan pekerjaanBig Data Ecosystem : Hadoop (HDFS, YARN), Hive, Spark, Sqoop, MapReduce, Oozie, Flume. Databases : MariaDB and / or Oracle DB (SQL, PL / SQL). Programming : Java, Scala, or Python for Spark / MapReduce development. Data Ingestion : Sqoop, Kafka, Nifi (for integrating RDBMS with Hadoop). Query Optimization : Hive tuning, partitioning, bucketing, indexing. Tools : Ambari, Cloudera Manager, Git, Jenkins. OS & Scripting : Linux / Unix shell scripting. Strong analytical skills and problem-solving abilities. Good communication skills for working with cross-functional teams. Ability to manage priorities in a fast-paced environment. Experience with cloud-based big data platforms (AWS EMR, Azure HDInsight, GCP Dataproc). Knowledge of NoSQL databases (HBase, Cassandra). Exposure to machine learning integration with Hadoop / Spark.
Job Summary :
We are looking for a Big Data Hadoop Developer to design, develop, and maintain large-scale data processing solutions. The ideal candidate should have strong hands-on experience with the Hadoop ecosystem and integration with relational databases such as MariaDB or Oracle DB for analytics and reporting.
Key Responsibilities :
- Design, develop, and optimize Hadoop-based big data solutions for batch and real-time data processing.
- Work with data ingestion frameworks to integrate data from MariaDB / Oracle DB into Hadoop (Sqoop, Apache Nifi, Kafka).
- Implement Hive, Spark, and MapReduce jobs for data transformation and analytics.
- Optimize Hive queries, Spark jobs, and HDFS usage for performance and cost efficiency.
- Create and maintain ETL pipelines for structured and unstructured data.
- Troubleshoot and resolve issues in Hadoop jobs and database connectivity.
- Collaborate with BI, analytics, and data science teams for data provisioning.
- Ensure data security, governance, and compliance in all solutions.
Technical Skills :
Soft Skills :
Nice to Have :
Buat amaran kerja untuk carian ini
Developer • Kuala Lumpur, Federal Territory of Kuala Lumpur, MY
Pekerjaan berkaitan Proficiency in DigDash Enterprise is mandatory.Strong knowledge of SQL and practical experience working with Vertica as a data warehouse / data lake engine.
Solid understanding of data modeling, metad...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu 
Regulated and trusted by financial institutions globally.Pioneers in mobile point-of-sale (mPOS) solutions focusing on low-cost acceptance payment.
Secured US$30M Series B funding.Rapid growth : scal...Tunjukkan lagiKemas kini terakhir: 26 hari yang lalu
Hyperion Planning / Hyperion Essbase / OBIEE.Oracle 11g and 12c / Oracle Essbase and Windows 2008.Language : Experience in PL / SQL , Unix Shell Scripting, Essbase scripting, OBIEE RPD development.Windows...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu
)
![Senior Staff Data Scientist [up to 30k]](https://cdn-logos.talent.com/v1/logo/image?feedcode=whatjobs-my&company_name=Randstad%20Malaysia)
Dashboard Developer
Unison GroupKuala Lumpur, Federal Territory of Kuala Lumpur, MYQuick Apply
- Dinaikkan pangkat
Senior Data Platform Lead - EDW & Data Lake
LuxoftKuala Lumpur, Kuala Lumpur, Malaysia A leading technology consulting firm is seeking an experienced SR Technical Talent Acquisition Specialist to lead data analysis and integration in their Kuala Lumpur office.The role involves design...Tunjukkan lagiKemas kini terakhir: 3 hari yang lalu
- Dinaikkan pangkat
Senior Data Engineer
XENERA MALAYSIA SDN. BHD.Petaling Jaya, Selangor, Malaysia Data Management : Develop, monitor, and maintain ETL (Extract, Transform, Load) processes to ensure data is accurately and efficiently loaded into data warehouses or data mart.Work with BI Architect...Tunjukkan lagiKemas kini terakhir: 5 hari yang lalu
- Dinaikkan pangkat
Databricks Architect
Avanade Inc.Kuala Lumpur, Kuala Lumpur, Malaysia Our talented Data & AI Practice is made up of globally recognized experts - and there’s room for more analytical and ambitious data professionals.
If you’re passionate about helping clients make bet...Tunjukkan lagiKemas kini terakhir: 1 hari yang lalu
Lead / Senior Data Engineer
Capcon AsiaKuala Lumpur, MalaysiaQuick Apply
Developer - Hyperion Essbase / OBIEE
Two95 International Inc.kuala lumpur, Federal Territory of Kuala Lumpur, MYQuick Apply
- Dinaikkan pangkat
- Baharu!
Senior Data Engineer
Elitez Pte LtdPetaling Jaya, Selangor, Malaysia Pipeline Development : Design, build, and maintain batch and streaming data pipelines using GCP services such as BigQuery, Dataflow, Dataproc, Composer, Dataform, and Cloud Functions.Data Modeling &...Tunjukkan lagiKemas kini terakhir: kurang daripada 1 jam yang lalu
- Dinaikkan pangkat
Data Engineer
Link ComplianceKuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia My client is one of the leading digital banks in Malaysia.Design, develop, and maintain reliable and scalable data pipelines using Apache Airflow.
Implement data ingestion, transformation, and valid...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu
- Dinaikkan pangkat
- Baharu!
Data Platform Engineer - Azure Databricks | Flexible Hours
Second TalentKuala Lumpur, Kuala Lumpur, Malaysia A leading data solutions company is looking for a Data Engineer in Kuala Lumpur to enhance their data analytics capabilities.
The ideal candidate should have a degree in Computer Science and at leas...Tunjukkan lagiKemas kini terakhir: kurang daripada 1 jam yang lalu
- Dinaikkan pangkat
Senior Software Engineer (Big Data)
EPAM SystemsKuala Lumpur, Kuala Lumpur, Malaysia EPAM Systems Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia.Software Engineers at EPAM are the driving force behind strategic initiatives for our clients.
EPAM Malaysia, you will use your...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu
- Dinaikkan pangkat
Databricks Architect
AvanadeKuala Lumpur, Kuala Lumpur, Malaysia Avanade Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia.Join or sign in to find your next job.Avanade Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia.
Be among the first 25 appli...Tunjukkan lagiKemas kini terakhir: 14 hari yang lalu
- Dinaikkan pangkat
65097 Data Architect
half the skyKuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia Responsible for data lake design and providing technical direction to data engineer, data analysts, data integration developers and database administrators.
Provide input, monitor, and coordinate th...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu
- Dinaikkan pangkat
- Baharu!
Senior Data Engineer
Tranglo Sdn BhdKuala Lumpur, Kuala Lumpur, Malaysia Department : Data | Division : Technology | Location : Bangsar South, KL.Drive the implementation and optimization of centralized data repositories and data lake architectures, supporting enterprise-w...Tunjukkan lagiKemas kini terakhir: kurang daripada 1 jam yang lalu
- Dinaikkan pangkat
Regional Data & Analytics Head
SCIENTEKuala Lumpur, Kuala Lumpur, Malaysia Director - Global Talent Acquisition (Services & Projects).Lead the regional Data & AI strategy, governance, and delivery to drive innovation, compliance, and measurable business impact.Define and ...Tunjukkan lagiKemas kini terakhir: 12 hari yang lalu
- Dinaikkan pangkat
- Baharu!
Data Developer
RiDiK (a Subsidiary of CLPS. Nasdaq : CLPS)Kuala Lumpur, Kuala Lumpur, Malaysia Be among the first 25 applicants.Direct message the job poster from RiDiK (a subsidiary of CLPS, Nasdaq : CLPS).Aspiring IT Recruiter | Passionate About Connecting Tech Talent.Data Developer / Data ...Tunjukkan lagiKemas kini terakhir: 22 jam yang lalu
- Dinaikkan pangkat
Senior Staff Data Scientist [up to 30k]
Randstad MalaysiaKuala Lumpur, Kuala Lumpur, Malaysia As a Senior Staff Data Scientist, you will lead the technical vision and roadmap for the company's next‑generation segmentation engine.
You will drive architectural decisions, mentor senior data sci...Tunjukkan lagiKemas kini terakhir: 1 hari yang lalu
- Dinaikkan pangkat
Senior Data Engineer - Remote & AWS Big Data Leader
IPG Mediabrands MalaysiaSubang Jaya, Subang Jaya, Malaysia A leading technology-driven performance marketing agency is seeking a highly motivated Senior Data Engineer.You will work with teams to analyze requirements and build data solutions.The ideal candi...Tunjukkan lagiKemas kini terakhir: 3 hari yang lalu
- Dinaikkan pangkat
Associate I, Data Engineer
Air SelangorKuala Lumpur, Kuala Lumpur, Malaysia Assist in the development of data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams.
To work on optimal data delivery architecture that is con...Tunjukkan lagiKemas kini terakhir: 7 hari yang lalu