Talent.com
This job offer is not available in your country.
Databricks Engineer

Databricks Engineer

Avensys ConsultingKuala Lumpur, Kuala Lumpur, Malaysia
14 hours ago
Job description

Global Recruitment Head at Avensys Consulting

Avensys is a reputed global IT professional services company, and our service spectrum includes enterprise solution consulting, business intelligence, business process automation and managed services. And we service a client base across banking and financial services, insurance, information technology, healthcare, retail, and supply chain.

We are currently looking for a Databricks Engineer. This is an exciting opportunity to expand your skill set, achieve job satisfaction and work-life balance. More details as below.

Key Responsibilities :

  • Design and implement scalable data pipelines using Apache Spark , Delta Lake , and Databricks Workflows .
  • Build and maintain ETL / ELT processes on Databricks Lakehouse Platform to support BI and advanced analytics using Delta Live Tables .
  • Optimize performance of data pipelines and queries using Spark tuning and caching strategies.
  • Implement and maintain CI / CD pipelines for data engineering workflows using tools like Databricks Repos , Git , and Azure DevOps .
  • Secure and govern data using Unity Catalog , data masking , and role-based access controls .
  • Integrate with upstream / downstream systems such as AWS S3 , Snowflake , or Power BI . Good Experience on Databricks Asset Bundles .
  • Develop documentation and promote best practices in the use of Databricks notebooks and workflows.

Required Qualifications :

Mandatory

  • 5 to 8 years of experience in data engineering, analytics, or platform engineering roles.
  • Proven hands-on experience with Databricks , Spark , Delta Lake .
  • Proficiency in Python and SQL .
  • Strong understanding of distributed computing and cloud data architecture and data warehousing.
  • Familiarity with DevOps practices and tools for CI / CD and infrastructure as code.
  • Nice-to-have

  • Knowledge of Lakehouse architecture , Unity Catalog , and Databricks SQL .
  • Experience with data governance, metadata management, and security controls.
  • Databricks certifications (e.g., Databricks Certified Data Engineer Associate / Professional ).if you are getting higher
  • WHAT’S ON OFFER

    You will be remunerated with an excellent base salary and entitled to attractive company benefits. Additionally, you will get the opportunity to enjoy a fun and collaborative work environment, alongside a strong career progression.

    To submit your application, please apply online or email your UPDATED CV in Microsoft Word format to Your interest will be treated with strict confidentiality.

    #J-18808-Ljbffr

    Create a job alert for this search

    Engineer • Kuala Lumpur, Kuala Lumpur, Malaysia

    Related jobs
    • Promoted
    • New!
    Big Data Engineer

    Big Data Engineer

    Accord InnovationsKuala Lumpur, Kuala Lumpur, Malaysia
    Senior Talent Acquisition Specialist @ Accord Innovations | Strong Technical / Business Acumen.Design, develop, and optimize big data pipelines using Apache Spark (batch and streaming).Implement data...Show moreLast updated: 14 hours ago
    Data Engineer

    Data Engineer

    Two95 International Inc.Kuala Lumpur, Federal Territory of Kuala Lumpur, MY
    Quick Apply
    Hiring Local Malaysians only - CONTRACT JOB - 12 MONTHS (EXTENDABLE).DATA ENGINEER - IT with Extensive experience in "Healthcare ". With Minimum Experience - 3 years & Maximun Experience - 15 ye...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    KAF GroupKuala Lumpur, Kuala Lumpur, Malaysia
    Senior Manager, Group HR, Recruitment & Training.The Senior Data Engineer will play a critical leadership role in architecting, building, and scaling the data infrastructure that powers KAF Digital...Show moreLast updated: 1 day ago
    Data Engineer - Snowflake

    Data Engineer - Snowflake

    Oxydata SoftwareKuala Lumpur, Malaysia
    Quick Apply
    Greater Kuala Lumpur, Malaysia.Our client is a global leader in sustainable building materials, generating multi-billion annual revenue with operations in over 40 countries and a workforce exc...Show moreLast updated: 17 days ago
    • Promoted
    Data Engineer (Spark, SQL)

    Data Engineer (Spark, SQL)

    Unison GroupKuala Lumpur, Kuala Lumpur, Malaysia
    We are looking for a proficient Data Engineer with strong skills in Spark and SQL to join Unison Group.The successful candidate will be responsible for designing, building, and managing data pipeli...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer (Azure and PowerBI)

    Data Engineer (Azure and PowerBI)

    Procter & GambleKuala Lumpur, Kuala Lumpur, Malaysia
    Would you like to harness the power of Information Technology through combining breakthrough technology and business consulting with our business teams?. Then a career in our P&G IT Function is just...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Link ComplianceKuala Lumpur, Kuala Lumpur, Malaysia
    Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia.My client is one of the leading digital banks in Malaysia.Design, develop, and maintain reliable and scalable data pipelines using Apache A...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    STRATEQPetaling Jaya, Selangor, Malaysia
    We are seeking a talented and experienced Senior Data Engineer to join our dynamic team at.STRATEQ GROUP (Strateq Sdn Bhd). As a Senior Data Engineer, you will play a crucial role in designing, deve...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    Encora Inc.Kuala Lumpur, Kuala Lumpur, Malaysia
    Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia.Senior Data Engineer to lead the development and optimization of our data infrastructure. Responsible for building scalable data pipelines, ...Show moreLast updated: 14 hours ago
    • Promoted
    • New!
    Senior Full stack Engineer (Remote)

    Senior Full stack Engineer (Remote)

    Capcon AsiaSepang, Selangor, Malaysia
    About the job Senior Full stack Engineer (Remote).Enhance regulatory compliance in early-stage clinical trials.Expand patient access to new treatments through clinical trials.Built by industry vete...Show moreLast updated: 14 hours ago
    • Promoted
    Manager, Data Platform Engineer

    Manager, Data Platform Engineer

    AIA Hong KongKuala Lumpur, Kuala Lumpur, Malaysia
    Are you ready to shape a better tomorrow?.AIA Digital+ is a Technology, Digital and Analytics innovation hub dedicated to powering AIA to be more efficient, connected and innovative as it fulfils i...Show moreLast updated: 1 day ago
    • Promoted
    • New!
    Business Analytics Engineer (Remote)

    Business Analytics Engineer (Remote)

    Bluesky HR Consultancy Inc.Sepang, Selangor, Malaysia
    We are hiring an ML / Data Engineer to support our data science and analytics initiatives.This role is responsible for performing data cleaning and transformation, and implementing scalable modeling ...Show moreLast updated: 14 hours ago
    Senior / Mid Data Engineer (ZALORA)

    Senior / Mid Data Engineer (ZALORA)

    GLOBAL FASHION GROUP SGP SERVICES PTE LTD.Kuala Lumpur, Kuala Lumpur, MY
    Quick Apply
    ZALORA Group is looking for a Senior Data Engineer to join its Data Science Team.As a Senior Data Engineer, you will : Work daily with machine learning problems.For this purpose, y...Show moreLast updated: 17 days ago
    • Promoted
    • New!
    Cloud Deployment Engineer (Up to RM10,000 | Hybrid & Flexible)

    Cloud Deployment Engineer (Up to RM10,000 | Hybrid & Flexible)

    BGC GroupKuala Lumpur, Kuala Lumpur, Malaysia
    Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia.Network Operations Center (NOC).Monitor and maintain system performance to ensure application and infrastructure stability.Troubleshoot and...Show moreLast updated: 14 hours ago
    • Promoted
    Analytics Engineer

    Analytics Engineer

    DataLaksa Sdn BhdPetaling Jaya, Selangor, Malaysia
    This is a full-time hybrid role for an Analytics Engineer at DataLaksa Sdn Bhd.The role is based in Petaling Jaya, Malaysia, with some work-from-home flexibility. Design, develop, and maintain data ...Show moreLast updated: 5 days ago
    • Promoted
    AWS Data Platform Services Engineer

    AWS Data Platform Services Engineer

    eSync Software ServicesKuala Lumpur, Malaysia
    Acting as a solution lead and guide the project team members for the entire AWS Data Platform services setup.Developing and plan for the implementation among the team members for the delivery.Worki...Show moreLast updated: 3 days ago
    • Promoted
    • New!
    Data Engineer / Senior Data Engineer

    Data Engineer / Senior Data Engineer

    MoneyHero GroupSepang, Selangor, Malaysia
    This is a fully remote role based in Malaysia.We will prioritise candidates who are based in Malaysia and do not require a work visa sponsorship. MoneyHero Group (Nasdaq : MNY) is a market leading fi...Show moreLast updated: 14 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    Avensys ConsultingKuala Lumpur, Kuala Lumpur, Malaysia
    Sr IT Recruiter - APAC (Singapore, Malaysia, South Korea, Japan, Thailand and Philippines) at Avensys Consulting.Avensys is a reputed global IT professional services company headquartered in Singap...Show moreLast updated: 3 days ago
    • Promoted
    Manager, Data Engineer

    Manager, Data Engineer

    AIA Hong KongKuala Lumpur, Kuala Lumpur, Malaysia
    Are you ready to shape a better tomorrow?.AIA Digital+ is a Technology, Digital and Analytics innovation hub dedicated to powering AIA to be more efficient, connected and innovative as it fulfils i...Show moreLast updated: 1 day ago
    • Promoted
    Data Centre Operations Engineer (Shift)

    Data Centre Operations Engineer (Shift)

    AIMS Data CentreCyberjaya, Selangor, Malaysia
    To provide efficient, effective technical support to both internal and external customers, Telco’s vendor, suppliers, contractors with the objective of coordinating, managing, solving their problem...Show moreLast updated: 30+ days ago