Data Engineer_Kafka

Encora Inc. Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia Overview

Data Engineer_Kafka role at Encora Inc. Location : Kuala Lumpur. Experience : 5+ years. Job mode : Contract. Work mode : On-site. Responsibilities & Duties

Design, develop, and maintain real-time data pipelines using Apache Kafka and related technologies. Build robust, scalable, and fault-tolerant streaming data platforms. Configure and manage Kafka clusters, topics, partitions, producers, and consumers. Integrate Kafka with various data sources and sinks (databases, APIs, cloud storage, etc.). Ensure data quality, availability, and consistency across streaming platforms. Monitor, tune, and optimize the performance and throughput of Kafka pipelines. Work with DevOps and infrastructure teams to automate deployment and scaling of Kafka environments. Implement data governance, security, and compliance policies for streaming systems. Collaborate with data scientists, analysts, and engineers to deliver high-impact data solutions. Troubleshoot production issues related to Kafka pipelines and implement preventative measures. Qualifications & Skills

Bachelor's or Master's degree in Computer Science, Engineering, or related field. 5+ years of experience in data engineering or backend development. Strong hands-on experience with Apache Kafka, Kafka Streams, Kafka Connect, and Schema Registry. Proficient in programming languages such as Java, Scala, or Python. Deep understanding of distributed systems and stream processing architectures. Experience with messaging systems and event-driven architectures. Strong understanding of SQL and NoSQL databases. Experience with CI / CD, version control (Git), and cloud infrastructure (AWS, Azure, or GCP). About Encora

Encora is the preferred digital engineering and modernization partner of some of the world\'s leading enterprises and digital native companies. With over 9,000 experts in 47+ offices and innovation labs worldwide, Encora\'s technology practices include Product Engineering & Development, Cloud Services, Quality Engineering, DevSecOps, Data & Analytics, Digital Experience, Cybersecurity, and AI & LLM Engineering. At Encora, we hire professionals based solely on their skills and qualifications, and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality. Additional information

Seniority level : Mid-Senior level Employment type : Contract Job function : Information Technology Industries : IT Services and IT Consulting

#J-18808-Ljbffr