Senior Data Engineer: Chemical Pipelines & Observability
Posted 3
views
Summary
Senior Data Engineer builds and maintains scalable data pipelines for chemical pipeline observability using Spark, Databricks, and Azure Data Factory with Kafka-compatible streaming.
Jobtailor in Helsinki is seeking a Senior Data Engineer to design and maintain scalable data pipelines across ingestion, transformation, and publishing stages. You will implement data quality controls, observability, and monitoring for large-scale datasets, working with streaming and batch processing systems such as Event Hubs or Kafka-compatible platforms.
The role requires deep experience in Spark, Databricks, and Azure Data Factory.