DevOps Engineer – Kafka Specialist

Open 30d

At Madiff, we connect top IT talent with cutting-edge companies through remote Agile teams and nearshore outsourcing. With operations in Poland, Portugal, France, and the UK, we specialize in AI, DevOps, and Cybersecurity – supporting industries like Telecom, Banking, and Hi-Tech.

We are looking for a Kafka Infrastructure Engineer to join a high-performing team focused on building and maintaining robust streaming infrastructure. You’ll be working on complex enterprise environments, ensuring the reliability and performance of Kafka-based platforms that support key business applications and services.

Responsibilities:
  • Manage and maintain high-availability Kafka clusters in production
  • Monitor Kafka using tools like Burrow, identify lags and performance bottlenecks
  • Handle topic configurations, partitioning, replication, and Zookeeper coordination
  • Deploy and configure Kafka environments using Ansible
  • Work with developers to support application releases and environment expansions
  • Liaise with Cloudera support on Kafka-specific issues
  • Maintain and support MirrorMaker/SRM for cross-cluster replication
  • Support DR processes and participate in on-call rotations
  • Log parsing and integration (e.g. Logstash)
  • Collaborate with cross-functional teams to optimise performance and stability


Requirements

  • Strong experience operating Kafka clusters in a production environment
  • Knowledge of Kafka internals: topics, partitions, replication, Zookeeper
  • Hands-on experience with Ansible for configuration management
  • Exposure to Cloudera Kafka distribution (nice to have)
  • Knowledge of SQL
  • Experience with MirrorMaker/SRM
  • Familiarity with log processing tools and Kafka monitoring
  • Readiness to work on-call and support critical environments
  • Good communication skills and ability to collaborate across teams


Benefits

  • Hybrid work model – 1 day per week in the client's office in Warsaw
  • Comprehensive medical care
  • Solid, competitive salary.
  • Work in multilingual, multinational and multicultural environment on international projects