Data Engineer
Summary
Data Engineer building a brand-new Databricks Lakehouse platform from scratch at a global company's HQ in Staffordshire, UK. Day to day: ingest from SAP, Salesforce and telemetry, build batch/streaming PySpark pipelines across bronze/silver/gold layers, and add Unity Catalog governance and BI models for Tableau/Power BI.
A rare chance to get in on the ground floor of a major greenfield Databricks implementation at one of the world's most recognised brands.
This is a transformational data journey and an opportunity for a Data Engineer to help build a Databricks Lakehouse platform from scratch. You won't be maintaining legacy pipelines, you'll be building something brand new and shaping the future of data at a global business.
What makes this stand out is who you'll be working alongside. A Tier 1 SI partner has been brought in to architect the platform, with Databricks themselves at the table ensuring everything is built to the highest standards from day one. The knowledge and exposure you'll gain is something most engineers simply don't get access to.
What You'll Be Doing
You'll be ingesting data from enterprise source systems including SAP S/4 HANA, SAP ECC, Salesforce, and telemetry data, building batch and streaming pipelines using PySpark, Spark SQL, Delta Live Tables, and Auto Loader across bronze, silver, and gold layers. You'll also model gold datasets for BI consumption in Tableau and Power BI, implement Unity Catalog governance, and collaborate on CI/CD and Infrastructure as Code.
It would be great if you have experience with some of the following:
- Strong hands-on Databricks experience
- PySpark, Spark SQL, and medallion architecture
- Unity Catalog and data governance
- Enterprise source system experience, SAP a strong advantage
- Comfortable in a greenfield environment
- Strong communicator who can knowledge share with a wider team
Why This Role?
- Greenfield build, own it from day one
- Work directly alongside a Tier 1 SI partner and Databricks specialists
- Continuous learning and best practice exposure throughout the project
- AI and ML ambitions on the horizon
- A globally recognised brand at an exciting point of transformation
The team work on-site at their global HQ in Staffordshire
If you want to work on something meaningful, learn from the very best, and leave a real mark on a world-class data platform, we'd love to hear from you.