Data Engineer
Summary
A Data Engineer joins a public-sector organisation's digital transformation programme in Cardiff, designing and maintaining cloud-based data solutions (ideally GCP), building and optimising ETL/ELT pipelines, and delivering secure, high-quality data products for reporting and analytics within Agile multidisciplinary teams.
Organisation | Public Sector / Digital Transformation
A leading organisation undergoing a significant digital transformation programme is seeking an experienced Data Engineer to join a high-performing technical team.
This is an exciting opportunity to play a key role in designing, building, and maintaining modern cloud-based data solutions that support data-driven decision-making across the organisation. Working within an Agile environment, you'll help develop scalable data platforms, optimise data pipelines, and contribute to the delivery of robust, secure, and high-quality data products.
Responsibilities
- Design, develop and maintain scalable cloud-based data solutions
- Build and optimise ETL and ELT pipelines
- Support the migration of existing data services into cloud environments
- Develop and maintain data products that support reporting and analytics
- Implement CI/CD processes and engineering best practices
- Monitor, troubleshoot and improve data platform performance
- Work closely with technical and business stakeholders to gather requirements and deliver effective solutions
- Ensure data quality, governance, and security standards are maintained
- Contribute to data architecture, documentation, and continuous improvement initiatives
- Collaborate within multidisciplinary Agile delivery teams
What They're Looking For:
- Strong experience with Python and SQL
- Experience building and maintaining enterprise data pipelines
- Experience working with cloud technologies, ideally Google Cloud Platform
- Knowledge of relational databases and data warehousing
- Experience with version control tools such as Git
- Understanding of data modelling principles
- Experience working with large-scale datasets
- Knowledge of workflow orchestration tools
- Strong stakeholder engagement and communication skills
- Experience working within Agile delivery environments
Desirable Experience:
- Google Cloud certifications
- Experience with Docker or containerisation technologies
- Exposure to BigQuery, Spark, Dataproc, or similar technologies
- Knowledge of DataOps and DevOps practices
- Understanding of UK GDPR and data governance principles