AWS Data Engineer

AWS Data Engineer – SC Cleared

Active SC Clearance required

We’re looking for experienced AWS Data Engineers to join a growing technology consultancy delivering complex cloud and data solutions.

This is a hands-on engineering role focused on designing, building and maintaining scalable data pipelines and infrastructure using AWS-native services. You'll work across data orchestration, automation and containerisation, helping deliver secure, reliable and high-performance data solutions.

We're open to candidates at different experience levels who have strong AWS data engineering expertise and enjoy solving complex technical challenges.

Key responsibilities:

• Design, develop and maintain scalable data pipelines using Python, SQL and Apache Airflow.
• Build and optimise cloud-based data solutions using AWS services including Redshift, Glue, Lambda, Step Functions, Batch and OpenSearch.
• Develop and manage containerised applications and workflows using Docker.
• Implement and maintain data orchestration processes, ensuring efficient and reliable data processing.
• Collaborate with engineering teams and stakeholders to deliver secure, scalable data infrastructure.
• Monitor, troubleshoot and optimise data pipeline performance and reliability.
• Work with GitLab or similar tools for version control and CI/CD.
• Ensure data quality, governance and security best practices are followed.
• Contribute to technical documentation, automation and continuous improvement initiatives.

We're looking for someone with:

• Strong hands-on experience in AWS Data Engineering.
• Excellent Python programming skills and strong SQL proficiency.
• Experience using Apache Airflow for workflow orchestration and DAG management.
• Practical experience with Docker and containerisation.
• Strong knowledge of AWS data services, particularly Redshift, Glue, Lambda, Step Functions, Batch and OpenSearch.
• Experience with CI/CD pipelines, Git and YAML-based configurations.
• Good understanding of AWS security, IAM policies and role-based access control (RBAC).
• Strong problem-solving skills and the ability to troubleshoot complex data engineering issues.
• Experience working in Agile environments and collaborating with cross-functional teams.
• Good communication and stakeholder management skills.

Desirable experience:

• Additional AWS services such as Athena, SQS, CloudWatch, CloudTrail and EMR.
• Infrastructure as Code tools such as Terraform or CloudFormation.
• Experience working in consultancy or client-facing environments.
• Familiarity with technical documentation tools such as Confluence.

Security Clearance requirements:

• Must hold active SC Clearance.
• Must be able to maintain the required level of security clearance throughout the engagement.