Data Engineer: Real-Time Pipelines on Databricks
Summary
Talantir is hiring a Data Engineer in Greater Manchester (hybrid) to build and optimise real-time and batch data pipelines on a Databricks Lakehouse using Spark Structured Streaming and Kafka (MSK), with CI/CD for data workflows and collaboration with BI, product, and engineering teams.
Talantir is hiring a Data Engineer to design and optimise scalable data pipelines in a Databricks Lakehouse. You will work with streaming and batch data using Spark Structured Streaming and Kafka (MSK), ensuring efficient data flows and governance across analytics, reporting, and operations.
Your role includes CI/CD for data workflows and close collaboration with BI, product, and engineering teams. The position offers a hybrid working model in a collaborative office environment with a