Azure Databricks Data Engineer: Pipelines & Governance
Posted 1
view
Summary
Data Engineer at Somerset Bridge building and optimising scalable data pipelines on Azure Databricks and Delta Lake for the insurer's data platform, supporting Pricing, Underwriting and analytics with a focus on data quality, governance and both real-time and batch processing.
Somerset Bridge Group is transforming its data platform to a modern Azure-based data ecosystem. As a Data Engineer you will design, build and optimise scalable data pipelines on Databricks and Delta Lake, supporting Pricing, Underwriting and analytics.
You will collaborate with Data Architects and Analysts to ensure data quality, governance and real-time/batch processing, delivering secure, high-performance data solutions across the organisation.