Data Engineer AWS & AI
Summary
Data engineer building AWS data pipelines for a consumer intelligence platform handling trillions of opt-in behavioural signals from a paid panel. Day to day: Python, SQL and Spark/PySpark in a small team, using AI tools like Claude for development while reviewing and validating AI-generated code.
Every so often a platform comes along that is doing something genuinely new. This is one of them.
We are recruiting an AWS Data Engineer for a consumer intelligence business in Central London.
You'll be working on the data pipelines behind trillions of behavioural signals, all collected from a panel of real people who actively opt in and are paid for their data.
The above is the foundation of the role but the future will be wherever cutting edge data engineering leads!
Why it's amazing
- Real scale, working with AWS, Python, SQL and Spark/PySpark across datasets most engineers won't normally get near
- Real ownership, working in a small, collaborative team where you can influence the platform and work across the full data lifecycle
- AI-assisted engineering, with Claude used daily for development, debugging, testing and documentation, but with engineers responsible for reviewing and validating what it produces
- A genuinely new platform, with the product being built out now following fresh venture and strategic investment
We'd like to hear from you if you have solid commercial experience with AWS, Python and SQL, practical Spark or PySpark experience, and are excited to be working with, experimenting with and validating AI-generated code! Client uses claude but they are open minded on the flavour of AI the right candidate has been using.
Full right to work in the UK required. No sponsorship available.
If you don't tick every box but it's a role you'd like to grow into, still get in touch.
Not for you but know someone who might be right? We also have a referral scheme, with a gift or voucher for anyone you introduce who we go on to place.
#DataEngineering #AWS #PySpark #Python #DataPlatform #AIAssistedDevelopment #LondonJobs #DataJobs #Hiring #DataAndAnalytics
Women in Data advertise roles on behalf of our partners, alliances, and members.
We are proud supporters of Women in Data. Connect, engage and belong to the largest free female data community in the UK - visit: www.womenindata.co.uk to join our community.
Stay connected! Follow us on LinkedIn for updates on career opportunities and more.