Senior Data Engineer
Summary
Senior Data Engineer (via recruiter Caspian One) joining a global financial services organisation's Cybersecurity Science & Analytics function in Birmingham. Day to day: designing and operating Azure cloud data pipelines and ETL for a cybersecurity data lake, with Python, Linux, Terraform, CI/CD, and SIEM/SOAR tooling.
A leading global financial services organisation is seeking a Senior Data Engineer to join its
Cybersecurity Science & Analytics function.
The successful consultant will join a multi-skilled Platform & Data Engineering team responsible for
delivering engineering capabilities across a strategic cybersecurity data lake and analytics platform.
The role combines data engineering, cloud infrastructure, automation, platform operations and
production support responsibilities.
Responsibilities
- Design, develop and optimise cloud-based data pipelines and ETL workflows.
- Ingest data from internal and external sources into enterprise data platforms.
- Create and maintain curated datasets and reusable data assets.
- Improve reliability, automation and operational resilience of data services.
- Support Azure cloud infrastructure and data platform operations.
- Work closely with engineering teams to onboard new data sources and define schemas.
- Contribute to exploratory data analysis and platform enhancement initiatives.
- Support real-time analytics and data availability improvements.
- Strong Data Engineering experience.
- Enterprise ETL and data pipeline development.
- Python or equivalent scripting experience.
- GitHub and CI/CD practices.
- Linux administration and scripting.
- Infrastructure as Code, ideally Terraform.
- Unity Catalog
- SIEM and SOAR platforms
Experience
- Cloud-based data platforms
- Data lake architecture and delivery
- Regulated industries advantageous
- Cybersecurity experience beneficial but not essential
- Collaborative global engineering team
- Multi-disciplinary technology environment
- Strong learning and development culture
- Exposure to cybersecurity, cloud platform engineering and advanced analytics