data engineer for AI training environments
Posted Updated 5
views
Summary
Design and build scalable data systems that acquire, clean, and deliver large messy datasets for AI training environments — including validation, sanitisation, and PII-removal layers — while making architecture decisions across storage, reliability, security, and cost. Hands-on software engineering on cloud infrastructure.
Описание
The company builds interactive, resettable digital environments where AI agents navigate software, complete tasks, fail, and improve. Its data systems provide a fundamental input for AI systems and training environments.
Задачи
- Design and build scalable systems for acquiring, ingesting, and integrating large, messy, and varied datasets
- Develop validation, sanitisation, and PII-removal layers to ensure data safety and quality
- Solve complex data problems involving duplication, corruption, inconsistent formats, and provenance
- Make architectural decisions across storage, reliability, observability, security, and cost
- Ensure reliable, high-quality data availability for AI training environment engineers
Требования
- Experience building and operating substantial production data systems end-to-end, including architecture, implementation, and production behaviour
- Strong software engineering fundamentals and hands-on coding experience beyond configuring tools
- Experience with large, complex, or messy datasets, including unstructured text, web, and machine-generated data
- Ability to articulate challenges associated with complex datasets
- Sound judgement across storage, processing, reliability, scalability, and cost
- Ability to discuss technical trade-offs
- Comfortable with cloud infrastructure and debugging complex production systems
Условия
Salary up to £200k.