Data Engineer
Mayfair - 2 days/week on site - 6 months initial, strong likelihood of extension - up to £600/day (outside IR35)
First data hire for a lean, fast-growing professional services firm built for an AI-enabled world. You'll work directly with the engineering lead to build and harden a Databricks lakehouse from scratch, and set the standards as the platform scales.
What you'll do
- Build ingestion pipelines into the Databricks lakehouse
- Model data through medallion layers in Delta Lake
- Build reconciliation and data quality checks into pipelines
- Set up governance via Unity Catalog
What you'll bring
- Deep, hands-on Databricks experience: Delta Lake, PySpark, Spark SQL, Unity Catalog
- Strong Python and production experience on a major cloud
- Comfortable owning workstreams end to end with minimal oversight
- Clear communicator, commercially aware
Nice to have
- Databricks AI/ML stack (MLflow, Vector Search, Mosaic AI)
- RAG or LLM-powered extraction experience