Senior AI Web Data Engineer – Agentic Search
Summary
Builds distributed web-scraping pipelines to feed real-time AI training data, focusing on resilience and evasion of anti-bot defenses.
Nebius is seeking a Software Engineer - Scraping Specialist to design and run large-scale web acquisition pipelines for real-time AI data. You will build distributed systems to capture and structure the live web, navigating evolving web protections and automation challenges.
The role blends browser, network, and automation expertise, delivering production-grade components with resilience, speed, and trustworthy data. Join a fast-moving, impact-driven team creating AI-ready cloud infrastructure.