Senior Data Engineer
Summary
Contract Senior Data Engineer (until end of September 2027) building real-time data pipelines that move live factory camera video and image data into applications for a global energy-technology client. Core stack: AWS with CDK infrastructure-as-code, Snowflake, Amazon Aurora, and Python backend integration.
Duration: Until end of September 2027 (with possibility to extend)
About the project
Our client, a global leader in energy technology, is launching a high-visibility initiative to build real-time applications on live data from one of its European factories. Cameras on the factory floor detect objects, and the applications must process this unstructured video and image data and respond instantly. The first release is due within 3 to 4 months, with the longer-term aim of scaling the solution to other sites. You will join once the Product Manager and Solution Architect are in place.
The role
You will build the pipelines that move camera data from the factory floor into the applications that act on it. You thrive in a collaborative, fast-paced environment. Strong AWS experience is essential, ideally with AWS CDK or similar infrastructure-as-code tools.
Key responsibilities
- Design, build and maintain scalable pipelines for real-time ingestion, transformation and analysis
- Process unstructured data at speed, especially video and images
- Build and maintain infrastructure as code with AWS CDK
- Implement and optimise storage in Snowflake and Aurora
- Work with the development team on Python backend integration
- Apply best practice in data modelling and data quality
- Monitor and troubleshoot pipelines to maintain availability and performance
Required skills and experience
- Proven Senior Data Engineer experience on complex transformation projects
- Hands-on work with unstructured data, ideally video
- Strong AWS skills, with hands-on AWS CDK
- Extensive Snowflake and Aurora experience
- Clear communicator who can explain technical concepts to non-technical stakeholders