Senior Data Engineer
Summary
Senior, hands-on Data Engineer designing, building and maintaining scalable data pipelines, connectors and streaming infrastructure to make data AI-ready and reliable for a UK client. The role spans database management, real-time/event-driven processing, data quality and governance, and technical leadership with stakeholders. Active SC clearance is essential.
Our client is looking for an experienced Senior Data Engineer to design, build and maintain scalable data infrastructure, with a particular focus on data integration, AI readiness and reliable data pipelines.
You will ensure that the data connectors, integrations and underlying infrastructure required to support AI initiatives are correctly implemented and maintained.
This is a senior, hands-on role involving complex data pipelines, streaming systems, database management and collaboration with technical and business stakeholders.
Responsibilities
Design, build and maintain scalable data pipelines, integrations and data services.
Develop and manage data connectors and infrastructure to support AI applications and analytics.
Lead the implementation of data streaming systems and optimise data processing performance.
Integrate data across operational systems, databases and business intelligence platforms.
Manage database performance, data quality, metadata and system reliability.
Troubleshoot data integration issues and implement improvements to security, scalability and resilience.
Provide technical leadership and collaborate with stakeholders to deliver effective data engineering solutions.
Essential Experience & Technical Skills
Proven experience as a Senior Data Engineer, delivering complex, large-scale data solutions.
Strong experience designing data pipelines, integrations and data connectors.
Experience developing data infrastructure to support AI applications and analytics.
Hands-on experience with data streaming technologies and database management.
Strong programming, scripting and data processing skills.
Experience optimising data performance, troubleshooting and maintaining reliable data services.
Ability to provide technical leadership and communicate effectively with stakeholders.
Active SC clearance is essential and must not be lapsed.
Experience integrating enterprise data sources with AI or machine learning platforms.
Knowledge of cloud-based data engineering technologies.
Experience with real-time data processing and event-driven architectures.
Understanding of data governance, security and metadata management.
Previous experience working within UK Government or highly regulated environments.