Junior Data Engineer | Commodities & Energy Trading | Databricks, Azure | Up to £45K + Bonus + [...]
Summary
Build and maintain scalable data pipelines on Databricks and Azure to support real-time and batch analytics for a global commodities and energy trading firm.
Junior Data Engineer | Commodities & Energy Trading | Databricks, Azure | Up to £45K + Strong Bonus + Benefits
Junior Data Engineer required for a leading global Energy & Commodities Trading organisation, recognised as one of the largest and most diversified participants within the market. The business operates across a broad range of asset classes including Natural Gas, LNG, LPG, Oil, Coal, Power, Freight and Environmental Products, supporting trading activity. Following continued growth and investment across its trading and technology functions, the organisation is expanding its data capabilities to support increasingly sophisticated and data-driven decision-making across the business.
This is an opportunity for a Junior Data Engineer to play a key role in the modernisation of a large-scale enterprise data platform, helping to transform how the business ingests, processes and leverages market and operational data. Sitting within the data team, you will be working across a broad landscape encompassing market data, real-time streaming, data governance and analytics. The business is undertaking a significant migration programme, moving legacy pipelines onto a modern data architecture built to support high-volume datasets, near real-time processing and scalable analytics capabilities.
As a Junior Data Engineer, you will be responsible for designing and engineering robust ingestion frameworks, supporting the migration of existing pipelines and contributing to the evolution of the central data platform. You will work with technologies including Kafka and Databricks to build scalable batch and streaming solutions. This role offers the opportunity to influence platform engineering standards and help shape a modern data ecosystem that underpins critical business and trading decisions across the organisation.
Details for the Junior Data Engineer:
- Salary: Up to £45,000 per annum + strong Bonus & Benefits
- Location: London (Hybrid – 2-3 days in the office per week)
What they are looking for in the Junior Data Engineer:
- Strong hands-on experience with Databricks, including building and optimising enterprise-scale data platforms
- Python development experience for building, orchestrating and maintaining high-performance data pipelines and ingestion frameworks.
- SQL skills for data validation, reconciliation, troubleshooting and performance optimisation across large and complex datasets.
- Demonstrable experience designing, migrating and modernising data pipelines within cloud-based environments, with a strong understanding of modern data engineering principles and best practices.
Desirable skills for the Junior Data Engineer:
- Exposure working with real-time and streaming data technologies, ideally Kafka, with an understanding of event-driven architectures and near real-time data processing
- Exposure to Medallion Architecture (Bronze, Silver, Gold) to support scalable and reliable data processing
Junior Data Engineer | Commodities & Energy Trading | Databricks, Azure | Up to £45K + Strong Bonus + Benefits