Kafka Engineer

Role & responsibilities

1. Customer Support & Issue Resolution

• • Provide L2/L3 technical support for Kafka-based systems.
• • Troubleshoot cluster, broker, producer, and consumer issues.
• • Diagnose and resolve performance bottlenecks, latency issues, and data inconsistencies.
• • Handle incidents and ensure SLA adherence.

2. Kafka & Confluent Platform Expertise

• • Support and maintain:
• • Apache Kafka clusters
• • Confluent Platform components (Schema Registry, Kafka Connect, ksqlDB, Control Center)
• • Assist customers with:
• • Topic configurations
• • Partitioning strategies
• • Replication and fault tolerance

3.Debugging & Root Cause Analysis

• • Conduct deep-dive investigations into system failures.
• • Use logs, metrics, and traces to identify root causes.
• • Provide postmortem reports and preventive recommendations.

4. Automation & Process Improvement

• • Automate operational tasks using Python, Shell scripts, Ansible, Terraform.
• • Develop runbooks, SOPs, and knowledge articles.
• • Continuously improve support processes and efficiency.

Required Skills:

• • 3-5 years of experience working with Apache Kafka and Confluent Kafka.
• • Strong knowledge of Kafka internals (brokers, zookeepers, partitions, replication, offsets).
• • Experience with Kafka Connect, Schema Registry, REST Proxy, and Kafka security.
• • Hands-on experience with AWS (EC2, IAM, CloudWatch, S3, Lambda, VPC, Load balancers).
• • Proficiency in scripting and automation using Terraform, Ansible, or similar tools.
• • Familiarity with DevOps practices and tools (CI/CD pipelines, monitoring tools like Prometheus/Grafana, Splunk, Datadog etc).
• • Experience with containerization (Docker, Kubernetes) is a plus.

Nice to Have:

• • Confluent Certified Developer or Administrator.
• • AWS Certified
• • CICD (AWS Code Pipeline, Harness)
• • Containers ( Docker, Kubernetes)

Preferred candidate profile

Perks and benefits