Senior Data Engineer (Flink)
Posted 1
view
Builds and runs real time streaming pipelines, keeping latency low and jobs recoverable at high
volume.
- Strong hands
on Apache Flink across DataStream API and Flink SQL. - Event time processing, checkpointing, savepoints, and state management in
production. - High volume Kafka streaming.
- Data modelling for analytics and streaming into a lakehouse.
- Monitors pipeline health and handles recovery when jobs fail.
Requirements
Requirements
pache Flink
(DataStream, Flink SQL), Kafka, Java, Scala, Python, SQL, Docker, Kubernetes
- Strong hands-on experience with Apache Flink, including DataStream API and Flink SQL.
- Experience with high-volume Kafka streaming and real-time data processing.
- Strong knowledge of event time processing, checkpointing, savepoints, and state management.
- Experience with data modelling for analytics and streaming into a lakehouse.
- Experience monitoring pipeline health and handling job recovery and failures.
- Apache Iceberg or other open table formats.
- Airflow.
- On premises or self managed cluster experience.
Skills
As published by workable · 3 questions · 3 written answers
First name, Last name, Email, Headline, Phone, Address, Photo, Pronouns, Education, Experience, Summary, Resume, Upload additional documents, Notice Period, Current Salary, Expected Salary
- How long have you used Flink, and what have you built with it?
- Do you use the DataStream API, Flink SQL, or both? Which more?
- Have you worked on clusters your own team ran, rather than a managed service?