Senior Data Engineer - Databricks
Posted Updated
Description
What We're Looking For
We're on the hunt for people who love solving problems, thinking critically and staying curious. If you've worked in data or tech before - amazing. If you've got a brain that enjoys untangling complex stuff and applying what you've learned - even better!
We're less about ticking boxes and more about whether you'd thrive in this environment:
- Do you get excited about helping clients move forward?
- Do you want to learn from people who are really good at what they do?
- Are you keen to experiment with the latest tools and ideas?
- Can you balance working independently and being a great teammate?
- 5 years experience using SQL, Python or other relevant technology?
- Experience working with Databricks and relevant certifications in Databricks or cloud platforms?
If you said "yes" more than once, let's talk.
Key Skills:
- As a Consulting Data Engineer, you're the builder - making sure data flows cleanly and reliably.
- Designing and building robust data pipelines using Databricks, Spark, and Delta Lake
- Implementing scalable and secure Lakehouse architectures on Databricks
- Collaborating with analysts, ML engineers, and platform teams to deliver Databricks-native solutions
- Applying best practices in data governance, CI/CD, and orchestration within the Databricks ecosystem
- Ensuring systems are secure, reliable and cost-effective
- 6+ years of experience in Python, Spark, and SQL for building scalable data pipelines in Databricks
- Deep experience with Databricks features including Delta Lake, Unity Catalog, and MLflow
- Workflow orchestration using Airflow or Databricks Workflows
- Integration experience with dbt, Fivetran, and Terraform for modern data stack automation
- Familiarity with cloud platforms (Azure, AWS, GCP)
- Knowledge and experience of data modelling techniques (Inmon, Data Vault, Kimball)
- Knowledge and experience of the data lifecycle, data management & governance, data platform architectures
- Knowledge and experience of Databricks data pipeline & data platform optimisation techniques