Data Engineer_Kafka

Encora Inc. Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia

Overview

Data Engineer_Kafka role at Encora Inc. Location : Kuala Lumpur. Experience : 5+ years. Job mode : Contract. Work mode : On-site.

Responsibilities & Duties

• Design, develop, and maintain real-time data pipelines using Apache Kafka and related technologies.
• Build robust, scalable, and fault-tolerant streaming data platforms.
• Configure and manage Kafka clusters, topics, partitions, producers, and consumers.
• Integrate Kafka with various data sources and sinks (databases, APIs, cloud storage, etc.).
• Ensure data quality, availability, and consistency across streaming platforms.
• Monitor, tune, and optimize the performance and throughput of Kafka pipelines.
• Work with DevOps and infrastructure teams to automate deployment and scaling of Kafka environments.
• Implement data governance, security, and compliance policies for streaming systems.
• Collaborate with data scientists, analysts, and engineers to deliver high-impact data solutions.
• Troubleshoot production issues related to Kafka pipelines and implement preventative measures.

Qualifications & Skills

About Encora

Encora is the preferred digital engineering and modernization partner of some of the world\'s leading enterprises and digital native companies. With over 9,000 experts in 47+ offices and innovation labs worldwide, Encora\'s technology practices include Product Engineering & Development, Cloud Services, Quality Engineering, DevSecOps, Data & Analytics, Digital Experience, Cybersecurity, and AI & LLM Engineering.

At Encora, we hire professionals based solely on their skills and qualifications, and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.

Additional information

#J-18808-Ljbffr