T-Hub - Data Engineer with Java
Summary
Build and optimize batch and streaming data pipelines in Java and Apache Beam, orchestrate with Airflow, and ensure robust testing and observability for analytics workloads.
WHAT TASKS AWAIT YOU?
- Design and implement batch and streaming pipelines; select Beam/Spark/Flink based on requirements.
- Data transformation ops for analytics and downstream services.
- Optimize jobs (performance, cost) and implement robust testing and observability.
- Build and manage Airflow orchestration.
- Troubleshoot production issues, lead incident resolution, and drive root-cause fixes.
- Contribute to team standards, templates, and reusable libraries.
- Using Java and Apache Beam as