SR Data Engineer with Scala & Kafka
Summary
Senior Data Engineer building and optimizing batch and streaming ETL workflows on GCP using Scala, Spark, Kafka, Airflow, and Dataproc within TCS's Data & Analytics unit.
About the Unit:
TCS Data & Analytics is powering the AI revolution by transforming data into a strategic enterprise asset. Built on the philosophy of Smart Data for Smarter AI, it enables organizations to create intelligent, AI-ready ecosystems that accelerate innovation, unlock new value, and drive business transformation at scale. As AI reshapes industries, TCS is helping businesses turn data into their most powerful competitive advantage.
Job Title: SR Data Engineer with Scala , Kafka
Work Location: Chennai
Experience: 6-15 years
Minimum Experience – 6 Years
Should know how to develop, deploy , monitor and optimize Etl workflows for both Batch and Streaming with Scala, Spark, Airflow, BQ , Kafka , Dataproc and GCP environments
Experience in Medallion architecture with proper Data quality checks and summarization activities
Experience in performance optimizations, Observability and runbook creations for continuous optimizations.
Good knowledge of Airflow orchestrations including dependency handing, idempotent execution etc.
Exposure to data governance and information security would be a plus
Through knowledge of handing streaming data including back pressure handling etc.