Talent.com
This job offer is not available in your country.
Assistant manager Data engineer

Assistant manager Data engineer

New Era Technology NZKuala Lumpur, Kuala Lumpur, Malaysia
1 day ago
Job description

Back to jobs

Assistant manager Data engineer

Kuala Lumpur, Malaysia

Join New Era Technology, where

People First

is at the heart of everything we do. With a global team of over 4,500 professionals, we're committed to creating a workplace where everyone feels valued, empowered, and inspired to grow. Our mission is to securely connect people, places, and information with end-to-end technology solutions at scale.

At New Era, you'll join a team-oriented culture that prioritizes your personal and professional development. Work alongside industry-certified experts, access continuous training, and enjoy competitive benefits. Driven by values like Community, Integrity, Agility, and Commitment, we nurture our people to deliver exceptional customer service.

If you want to make an impact in a supportive, growth-oriented environment, New Era is the place for you. Apply today and help us shape the future of work—together.

Hiring : Assistant Manager, Data Engineering – Malaysia (Client Location) | New Era Technology

Client Location : Kuala Lumpur

Company : New Era Technology –

Work Type : Full-Time, Permanent

About The Role

New Era Technology is looking for experienced

Assistant Manager, Data Engineering

to be deployed at our prestigious client in

Malaysia

at their

Kuala Lumpur

office.

The selected candidates will be part of the

Digital and Data

department will be responsible for system design, development and implementation of regional frontend systems.Provide maintenance and support on production systems.

Key Responsibilities

  • Design, develop, document and implement end- to-end data pipelines and data integration processes, both batch and real-time. This include data analysis, data profiling, data cleansing, data lineage, data mapping, data transformation, developing ETL / ELT jobs and workflows, and deployment of data solutions.
  • Monitor, recommend, develop and implement ways to improve data quality including reliability, efficiency and cleanliness, and to optimize and fine-tune ETL / ELT processes.
  • Recommend, execute and deliver best practices in data management and data lifecycle processes, including modular development of ETL / ELT processes, coding and configuration standards, error handling and notification standards, auditing standards, and data archival standards.

Position Description

  • Prepare test data, assist to create and execute test plans, test cases and test scripts.
  • Collaborate with Data Architect, Data Modeler, IT team members, SMEs, vendors and internal business stakeholders, to understand data needs, gather requirements and implement data solutions to deliver business goals.
  • BAU support for any data issues and change requests, document all investigations, findings, recommendations and resolutions.
  • KEY PERFORMANCE INDICATORS

  • Maturity level on technical skillsets of management and development on big data platform including data modeling design, data transformation, big data programming and performance tuning
  • Effectiveness of project contribution, including from technical support, project management and team collaboration perspective, to deliver data lake system on assigned local countries
  • Level of understanding on business requirements and capability to transform them into technical solution
  • Variety of new technologies (such as Azure and AWS Big Data Solution, Power BI, Tableau, Python and etc) and techniques being learnt that can be applied to solution delivery
  • EXTERNAL & INTERNAL CONTACTS

  • Group Infrastructure Team, Security Teams and Operation Team
  • Group Project Team
  • Local country Project Team (IT and User)
  • Qualifications / Experience

  • Bachelor's degree in IT, Computer Science or related Engineering.
  • At least 5 years of relevant experience in data engineering or related field
  • In-depth understanding of data structures, algorithms, databases, and software engineering.
  • Experience in data management and data warehousing technologies (data mart, data lake, lake house)
  • Ability to write efficient and scalable code
  • Experience with end-to-end data processing pipelines, ETL / ELT, and data warehousing
  • Knowledge of distributed systems and experience working with distributed data processing technologies.
  • 5+ years of professional experience in implementing operational data stores, data warehouses, data mart and large scale data architectures in Unix and / or Windows environments
  • 5+ years of hands-on ETL development experience, including transforming complex data structures from multiple sources
  • 5+ years of experience with big data technologies including Azure and AWS, Azure data factory, Databricks, Synapse, Hadoop, Hive, Storm, Presto, and real-time data transformation and processing technologies such as Confluent Kafka, ksqldb, kstream, Apache Flink, and Apache Spark Streaming.
  • 5+ years of experience in implementing data models using dimensional modeling and data vault modeling techniques.
  • Experience with scripting languages such as Shell, Perl or Python
  • Experience with any software development methodologies.
  • Knowledge & Technical Skills

  • Strong knowledge of various database technologies (RDBMS, NoSQL, and columnar).
  • Ability to handle and process different types of data (structured, semi-structured, and unstructured).
  • Strong proficiency in at least one programming language such as Python, Java or Scala.
  • Knowledge of MDM, Data Governance tools, and Informatica technologies.
  • Prior experience in the insurance industry is an advantage.
  • Knowledge of data security and privacy best practices, such as encryption and data masking
  • DevOps (CI / CD) and data privacy regulations knowledge.
  • Good to Have

  • Experience in API development and integration. E.g. SOAP, RestAPI
  • Build and modify APIs(Restful) and programs using Phyton or Java
  • Preferred Candidate

  • Nationality : Malaysians preferred
  • Availability : Immediate joiners or candidates who can join at short notice.
  • How To Apply

    Send your updated resume to

    with the subject line :

    "Assistant Manager, Data Engineering – Malaysia"

    About Us

    New Era Technology ) is a global IT services provider with a footprint in 80+ countries, delivering cutting-edge digital transformation, consulting, and staffing services across industries

    New Era Technology, Inc., and its subsidiaries ("New Era" "we", "us", or "our") in its operating regions worldwide are committed to respecting your privacy and recognize the need for appropriate protection and management of any Personal Data that you may provide us. In this, we are also committed to providing you with a positive experience on our websites and while using our products, services and solutions ("Solutions").

    View our Privacy Policy here

    Create a Job Alert

    Interested in building your career at New Era Technology? Get future opportunities sent straight to your email.

    Create alert

    Apply for this job

    indicates a required field

    First Name

    Last Name

    Email

    Phone

    Location (City)

    Resume / CV

    Attach

    Enter manually

    Accepted file types : pdf, doc, docx, txt, rtf

    How many years of experience you have in ETL Development

    Select...

    Do you have a minimum of 4 years of related experience for this role?

    Select...

    Do you have experience in Big Data technologies like Azure and AWS Big Data Solution, Hadoop, Hive, HBase, Spark, Sqoop, and Spark Streaming?

    Powered by

    Greenhouse

    Read our Privacy Policy

    Create a job alert for this search

    Data Engineer • Kuala Lumpur, Kuala Lumpur, Malaysia