Real Time Streaming Data Engineer

Roles and Responsibilities :

• Design, develop, test, deploy and maintain large-scale data pipelines using Apache Flink for real-time data processing.
• Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs.
• Develop complex SQL queries to extract insights from large datasets stored in Kafka topics.
• Troubleshoot issues related to streaming data ingestion, processing, and visualization.

Job Requirements :

• 5-30 years of experience in Data Engineering with expertise in Apache Flink, Real Time PCR (RTPCR), Kafka Streams.
• Strong understanding of SQL concepts including joins, aggregations, window functions etc.
• Experience working on big data technologies such as Hadoop ecosystem components like HDFS, MapReduce, YARN etc.