Big Data Engineer

Salary: £69,000 - 109,000 per year

• Proven experience working as a Data Engineer within complex technical environments.
• Strong knowledge of data management principles, including data modelling, integration, quality, and governance.
• Strong commercial experience with Snowflake and Databricks.
• Experience assessing existing data management systems and recommending improvements.
• Experience with modern data architectures, including cloud-based and distributed systems.
• Strong proficiency in SQL and Python.
• Experience with data engineering and pipeline technologies such as Apache Airflow and Spark.
• Experience working with cloud platforms, particularly AWS and Azure.
• Knowledge of big data technologies and distributed data processing.
• Understanding of data analytics and visualisation.
• Awareness of data standards, interoperability, data governance, and data sharing.
• Experience working with sensitive or security-conscious data environments would be highly beneficial.
• Strong analytical, problem-solving, communication, and stakeholder-management skills.
• Eligible to obtain high-level UK security clearance.
• British citizenship.
• Permanent UK residence for the previous five years.

• Interpret, validate, and analyse data requirements across complex environments.
• Gather, profile, and analyse large-scale structured datasets to ensure data accuracy, quality, and completeness.
• Design and implement robust ETL/ELT frameworks for ingesting, transforming, validating, normalising, and cleansing data.
• Develop and maintain scalable data pipelines to support analytics and operational decision-making.
• Implement data quality controls and prepare datasets for reporting and visualisation.
• Design and maintain data models to support analytical and operational requirements.
• Manage and optimise cloud and data storage solutions, including Amazon S3, Azure Blob Storage, BigQuery, and Snowflake.
• Contribute to data management standards, policies, governance frameworks, and best practices.
• Support data synthesis and anonymisation activities to ensure compliance, security, and appropriate data handling.
• Develop robust data models within secure and highly controlled environments.
• Monitor and optimise data workflows to improve performance, reliability, scalability, and cost efficiency.
• Evaluate emerging data technologies and identify opportunities to improve engineering capabilities.
• Contribute to data analytics and visualisation strategies.
• Present technical findings and recommendations to customers and stakeholders.
• Work collaboratively with technical and non-technical teams throughout the project lifecycle.

• Airflow
• AWS
• Azure
• Big Data
• BigQuery
• Cloud
• Databricks
• ETL
• Support
• Python
• SQL
• Security
• Snowflake
• Spark

More:

We are a specialist technical consultancy delivering bespoke technology and data solutions to solve complex operational challenges. We are growing our engineering team and offering an exciting opportunity for an experienced Data Engineer to support high-priority projects across Central Government, Defence, National Security, and Critical National Infrastructure. The role can be based from our UK offices in Bristol, Cheltenham, or London, or remotely from home, with occasional travel to customer sites and other company locations when required. We offer a flexible 37.5-hour working week, hybrid/remote working, learning and development support, career development opportunities, regular social events, an employer-matched pension scheme, comprehensive healthcare benefits, and a supportive, inclusive, team-focused culture. We are committed to equal opportunities and accessible recruitment.

last updated 37 week of 2026