Data Engineer
Description
Job Description Data Engineering II
Experience: 5+ Years
Role: Data Engineering II
Work Location: As per client requirement
Job Summary
We are looking for an experienced Data Engineer II with strong backend software development skills and hands-on experience in JVM-based programming, Apache Kafka, and Apache Flink.
The role involves building and maintaining scalable, high-throughput backend applications and real-time data streaming pipelines. The candidate will work on distributed data infrastructure, stream processing, ETL pipelines, and cloud-based streaming solutions.
Key Responsibilities
- Design and develop scalable backend and middleware applications capable of handling high throughput and concurrent workloads.
- Develop and maintain real-time stream processing applications using Apache Flink.
- Build and optimize ETL pipelines and batch/stream processing workflows.
- Work with Apache Kafka and distributed messaging systems.
- Improve data pipeline performance, reliability, monitoring, and scalability.
- Contribute to migration initiatives from on-premises Kafka to cloud-based technologies.
- Collaborate with product and Business Intelligence teams to deliver data-driven solutions.
- Participate in technical design and architectural decisions.
Required Technical Skills
- 5+ years of experience in software development and backend engineering.
- Strong programming experience in at least one JVM language: Java, Kotlin, or Scala.
- Hands-on experience with Apache Kafka and Apache Flink.
- Good knowledge of Python and SQL.
- Experience with Apache Spark and distributed data processing.
- Strong understanding of real-time streaming, ETL, and batch processing.
- Knowledge of REST APIs, JSON, gRPC, and WebSockets.
- Experience with data formats such as JSON, Avro, and Protobuf.
- Understanding of distributed systems, concurrency, fault tolerance, and high availability.
- Experience with Git, CI/CD, and software development best practices.
Good to Have
- AWS experience, particularly MSK, EKS, and OpenSearch.
- Docker and Kubernetes.
- Experience with cloud deployment technologies.
- Knowledge of functional programming, object-oriented programming, and TDD.
Ideal Candidate Profile
Candidates with strong Java/Kotlin/Scala backend development experience and hands-on Kafka and Flink exposure, particularly in real-time streaming and distributed systems.
Note: Strong JVM programming and backend engineering experience are essential for this role. Kafka and Flink hands-on experience will be highly preferred.
Skills
Sign in to read and join the discussion.