Messaging & Streaming Infrastructure Engineer

Job Description:

• Design, implement, and maintain messaging infrastructure supporting real-time data exchange between factory automation systems, MES, and enterprise IT platforms.
• Deploy and manage distributed messaging platforms such as Apache Kafka and MQTT.
• Enable real-time data streaming between shop-floor equipment, sensors, cloud platforms, and enterprise applications.
• Define and manage message topics, channels, and data schemas for equipment status, test results, alarms, and other events.
• Design real-time data pipelines using Pub/Sub patterns with a focus on high throughput, scalability, and fault tolerance.
• Develop and optimize message producers and consumers using Java, Scala, or Python.
• Configure and manage Kafka topics, partitions, replication, broker clusters, retention policies, consumer groups, and offset management.
• Monitor and troubleshoot messaging infrastructure to ensure reliable and efficient data delivery.

Requirements:

• Strong experience with message-oriented middleware and streaming platforms.
• Hands-on production experience with Apache Kafka preferred.
• Experience with RabbitMQ, IBM MQ, Apache Pulsar, or MQTT is an advantage.
• Experience with Kafka Connect or MQTT clients for device and application integration.
• Strong programming skills in Java, Scala, or Python.
• Good understanding of distributed messaging systems, consumer groups, offset management, retention policies, and delivery guarantees.
• Experience in manufacturing, factory automation, MES, IoT, or industrial systems is preferred.

This position is open to all who are fulfilling aforesaid requirement