Data Engineer
Summary
Build and maintain cloud-based data pipelines and integrations for a UK professional-services group, using Azure, Python, and SQL to standardize and deliver data for reporting, analytics, and AI.
We are seeking a Data Engineer to join the Data Team and play a key role in the development, operation, and evolution of the Group's Data Platform.
This role will be responsible for integrating new data sources into the DataCube platform, developing and supporting data pipelines, delivering new data engineering solutions, and contributing to the ongoing development of the Group's cloud data architecture.
The successful candidate will work across a wide range of initiatives, from acquisition integrations and system implementations to platform enhancements that support reporting, analytics, automation, and AI.
This role will be responsible for integrating new data sources into the DataCube platform, developing and supporting data pipelines, delivering new data engineering solutions, and contributing to the ongoing development of the Group's cloud data architecture.
The successful candidate will work across a wide range of initiatives, from acquisition integrations and system implementations to platform enhancements that support reporting, analytics, automation, and AI.
Data Integration & Platform Development
- Lead the integration of new data sources into the DataCube platform, including acquisitions, business applications, and strategic technology platforms.
- Analyse source systems and design scalable data ingestion approaches.
- Develop mapping, transformation, and validation logic to standardise data across the Group.
- Work with business stakeholders, IT teams, software vendors, and third-party suppliers to deliver integration projects.
- Support the migration of legacy reporting and data processes onto the Group data platform.
- Design and implement reusable integration frameworks to accelerate future onboarding of systems and entities.
Data Pipeline Development & Support
- Develop, enhance, and maintain data pipelines across the data platform.
- Build and optimise ETL/ELT processes for new and existing data sources.
- Troubleshoot and resolve pipeline failures and data quality issues.
- Implement monitoring and alerting to ensure reliable and timely data delivery.
- Perform root cause analysis on integration or data issues.
Platform Operations
- Monitor the daily operation of the data platform.
- Ensure data refreshes complete within agreed service levels.
- Maintain documentation for pipelines, integrations, and operational procedures.
- Support deployment and release activities across development and production environments.
- Work closely with infrastructure and IT teams on platform performance and security.
Data Architecture & Engineering
- Contribute to the ongoing development of the Group's Azure-based data architecture.
- Support implementation of scalable and reusable data engineering standards.
- Design efficient data models and transformation frameworks.
- Identify opportunities to improve performance, reliability, and maintainability.
- Evaluate new technologies and tooling to support future platform requirements.
Business & Project Support
- Collaborate with Data Analysts and business stakeholders to understand requirements.
- Support strategic projects involving acquisitions, system implementations, and business transformation.
- Translate business requirements into scalable technical solutions.
- Provide technical expertise on integration and architecture decisions.
- Data Engineering: Proven experience in a Data Engineer role. Experience building and maintaining ETL/ELT pipelines. Strong understanding of data integration practices and data lifecycle management. Experience supporting production data platforms.
- Cloud Platforms: Experience with Microsoft Azure data technologies. Experience working with cloud-based data lakes or data warehouses.
- Databases & Programming: Advanced SQL skills. Experience working with large datasets. Python development experience for data engineering and automation. Experience with data modelling and transformation techniques.
- Data Platform Operations: Monitoring and troubleshooting data pipelines. Experience implementing data quality controls. Understanding of CI/CD and deployment practices. Root cause analysis and incident resolution experience.
- Stakeholder Management: Ability to communicate technical concepts to non-technical stakeholders. Strong problem-solving skills. Ability to manage multiple projects simultaneously.
- Desirable: Experience of Databricks, Fivetran and/or Microsoft Fabric. Experience within professional services, finance, or accounting environments. Knowledge of Power BI data models. Understanding of data governance best practices.
Join us to advance your expertise in a dynamic environment where growth and learning are prioritised and your ability to lead and collaborate is valued and nurtured.
At Dains, we’re committed to helping our people build rewarding careers in an environment where they can learn, develop and succeed. From day one, you’ll be supported to grow your skills, broaden your experience and shape a career that reflects your ambitions.
We offer ongoing professional development tailored to your role, strengths and future goals, supported by clear career pathways so you can see how you’ll progress.
Alongside a competitive salary, our benefits package is designed to support your wellbeing and reward your contribution, including:
We offer ongoing professional development tailored to your role, strengths and future goals, supported by clear career pathways so you can see how you’ll progress.
Alongside a competitive salary, our benefits package is designed to support your wellbeing and reward your contribution, including:
- Flexible and hybrid/smart working options
- 25 days’ annual leave plus bank holidays, increasing with service, with the option to buy or sell days
- Financial security through life assurance and a competitive pension scheme, with access to private medical insurance through both company-funded and self-funded options
- Greener travel options through our electric car scheme and cycle to work programme
- A vibrant social culture with regular team and firm-wide events
- Enhanced maternity and paternity pay to support you and your family through life’s important moments
- Annual reward and recognition awards, celebrating the achievements and contributions of our people
- Employee resource groups promoting inclusion and connection
- “Dains in the Community”, supporting charity, wellbeing and local initiatives
We want our people to feel supported, valued and able to do their best work, with benefits that help you thrive both professionally and personally.