AWS Data Engineer | Airflow, Redshift & Secure Data Flows
Posted
Summary
A consultancy data engineer role in London building Python/SQL data pipelines orchestrated with Airflow and containerised with Docker, working across AWS services (Redshift, OpenSearch, Lambda, Glue, Step Functions, Batch) with Git/GitLab and CI/CD workflows.
True North Consulting Group Ltd is seeking a data-focused engineer to join our consultancy team in the UK. You will leverage Python and SQL to build data pipelines, orchestrated with Airflow, and containerised with Docker.
You will work with AWS services like Redshift, OpenSearch, Lambda, Glue, Step Functions, and Batch. The role requires hands-on experience with Git and GitLab for collaborative development, along with familiarity with CI/CD pipelines and YAML configurations.