Hiring: Senior Data Engineer
Summary
Senior Data Engineer (remote, India) who designs, builds, and optimizes scalable data pipelines with Apache Spark and develops Scala/Java microservices in a distributed environment. Also involves Redis caching, ensuring data infrastructure performance, and collaboration on data delivery.
Position: Senior Data Engineer
Location: REMOTE
Experience: 5+ years
About the Role:
We are looking for a Senior Data Engineer with strong hands-on experience in Apache Spark, Scala, and Java , coupled with a solid understanding of microservices architecture . The ideal candidate will be a self-starter, able to design and implement scalable data pipelines and services in a distributed environment.
Key Responsibilities:
- Design, build, and optimize scalable data pipelines using Apache Spark .
- Develop and maintain microservices in Scala/Java.
- Collaborate with cross-functional teams to define data requirements and delivery strategies.
- Ensure high availability, performance, and security of data infrastructure.
- Implement caching strategies using Redis or similar distributed caching tools.
Requirements:
- 5+ years of hands-on experience in data engineering.
- Deep expertise in Apache Spark , Scala , and Java .
- Experience designing and developing microservices-based architectures .
- Strong understanding of distributed systems and parallel processing.
- Working knowledge of Redis or equivalent distributed caching systems.
- Familiarity with CI/CD practices and cloud platforms is a plus.
Nice to Have:
- Experience with Kubernetes, Docker, or cloud-native environments.
- Exposure to data governance and quality frameworks.