Data Engineer - DEFRA
Summary
Build and maintain a cloud-based data platform for a UK government project, processing high-volume location datasets using Azure, Databricks, and Spark.
Senior Data Engineer - Azure
Central government | Outside IR35 | Remote | 6 months +
SR2 is working with a consultancy that is expanding its data engineering capability to support the delivery of a large-scale cloud data platform. They are looking for an experienced Data Engineer to help design and develop modern data solutions capable of handling complex, high-volume datasets.
You'll join a multidisciplinary team responsible for developing and evolving a cloud-based data platform. Working across the full data lifecycle, you'll help shape how data is collected, processed, governed and consumed, while contributing to architectural decisions and engineering best practice. A significant proportion of the work involves processing complex location-based datasets, making previous exposure to geospatial or mapping-related data highly beneficial.
Requirements:
- Strong commercial experience delivering data engineering solutions in Azure.
- Strong hands-on experience working with Azure Databricks
- Experience working with geospatial, mapping or location intelligence datasets
- Central UK government experience within recent 5 years
- Experience developing large-scale distributed data processing workloads.
- Strong Python and SQL development skills.
- Experience working with Spark-based technologies.
- Knowledge of modern cloud data platform patterns and architectures.
- Experience building and supporting automated data pipelines.
- Familiarity with CI/CD practices and modern software engineering principles.
- Strong troubleshooting and performance optimisation skills.
Details
- Outside IR35
- 450 a day
- Remote based
- 6 month contract
- Strong likelihood of extension
Please apply with a copy of your CV and Emma from SR2 will contact potential applicants regarding next steps.