SC Cleared Data Engineer — Azure Databricks & Pipelines
Summary
Designs and builds high-volume datasets and secure data pipelines using Azure Databricks, Spark, and CI/CD in a UK government environment.
iO Associates is seeking a Senior SC Cleared Data Engineer with extensive Azure Databricks experience to join a UK Central Government data team responsible for designing and developing high-volume datasets and robust data pipelines.
You will work with Spark-based technologies, build, automate and operate data pipelines, and apply CI/CD practices with Docker and Kubernetes in a secure government context.