Data Engineer – Databricks (Contract)
Posted Updated 8
views
Summary
Six-month contract for a Data Engineer to design, build and optimize data pipelines on Azure Databricks for a consultancy's major client, working 3 days per week from a London office. Core stack: Databricks, Spark, Python, ETL and CI/CD for data pipelines.
A consultancy is assisting a major client in a major data engineering initiative and are looking for a Data Engineer with strong experience in Databricks to play a key role in the development of a key data solution.
You will be responsible for the:
- Design, develop, and optimize data pipelines using Azure Databricks.
- Ensuring data reliability, scalability, and quality.
- Integrating data sources into a unified platform.
- Monitoring and troubleshooting data workflows.
Skills Required:
- 3+ years commercial experinece with 1+ year in Databricks
- Expertise in Azure Databricks, Spark, and big data tools.
- Knowledge of Python, ETL processes and cloud technologies.
- Familiarity with CI/CD practices for data pipelines.
This is a six-month contract 3 days in office based London. Umbrella rate up to £400/day. Immediate starters are preferred.