Data Platform Engineer (Lead II - Data Engineering)
Summary
Lead engineer role to design, build, and evolve an Azure- and Databricks-based cloud data platform, providing technical leadership and mentoring teams while driving Terraform-based IaC and DevOps practices in a hybrid Leeds (West Yorkshire) setting. Core tech: Azure, Databricks, Terraform, PySpark, Power BI, Power Automate.
Data Platform Lead Engineer
Role Description
We are seeking an experienced Data Platform Lead to drive the design, delivery, and evolution of a modern cloud-based data platform. You will provide technical leadership, shape platform architecture, engage with key stakeholders, and guide engineering teams in delivering scalable, secure, and high-performing data solutions.
Location: West Yorkshire-Multiple locations (Hybrid - 3 days onsite, mandatory)
Employment Type: Permanent | Fixed-Term Contract | Contract (Inside IR35)
Start Date: Immediate
Key Responsibilities
- Lead the architecture, design, and implementation of Azure and Databricks-based data platforms.
- Provide technical leadership, mentoring, and guidance to engineering teams.
- Collaborate with business and technical stakeholders to define platform roadmaps and best practices.
- Ensure platform scalability, reliability, security, and operational excellence.
- Drive adoption of Infrastructure as Code and DevOps best practices using Terraform and Azure services.
- Support strategic decision-making by aligning platform capabilities with business objectives.
Essential Skills & Experience
- Strong hands-on experience with Databricks development and platform architecture.
- Good understanding of Azure infrastructure, networking, and Terraform.
- Proven experience in solution architecture, technical design, and stakeholder management.
- Experience leading technical teams and driving delivery across multiple workstreams.
- Excellent communication skills with both technical and non-technical stakeholders.
- Self-motivated, proactive, and able to operate with minimal supervision
- Exposure to Power BI and Power Automate.
- Experience working within Agile delivery environments.
Key Requirements
- Strong technical leadership and stakeholder engagement capabilities.
- Ability to manage workload independently and drive initiatives proactively.
- Experience designing and supporting enterprise-scale cloud data platforms.
Skills
ETL, Power Automate, Power BI, PySpark