Senior Data Engineer - Energy Trading - London
Our client is a major commodity trader with 40 offices across the globe.
We are recruiting a mid‑senior Data Engineer with a background in Python, SQL, and AWS to build data pipelines and dashboards that inform trading decisions daily. The Data Engineering team is responsible for a fundamental data system processing 50+ billion rows of data per day and feeding directly into trading decisions.
The Data Engineer will be designing, implementing, and maintaining this system, keeping it reliable, resilient, and low‑latency.
Responsibilities
Design, implement, and maintain high‑throughput data pipelines that support real‑time trading decisions.
Partner closely with business stakeholders and engineering teams to understand data requirements and deliver the necessary infrastructure.
Collaborate in a dynamic environment with evolving requirements.
Qualifications
- 5+ years in the data engineering space
- Proficient with MPP databases (Snowflake (preferred), Redshift, Big Query, Azure DW)
- Deep AWS or cloud understanding across core and extended services
- 2+ years experience working with at least 3 of the following: ECS, EKS, Lambda
- Proficient with Python and SQL, and with good experience with data modeling
- Experience with a modern orchestration tool (Airflow / Prefect / Dagster / similar)
- Comfortable working in a dynamic environment with evolving requirements
- A background in a dynamic financial services environment (Investment Bank, Hedge Fund)
- BSc in Computer Science from a Russell Group University
- Exposure to trading and/or commodity business
- DBT experience
- Infrastructure as Code (Terraform, Cloud Formation, Ansible)