Backend Infrastructure Engineer, Anti-Bot
Summary
Builds and operates the anti-bot infrastructure of a web data extraction platform serving AI applications: proxy rotation, IP/session management, fingerprinting, and CAPTCHA handling to keep extraction fast and reliable against sites that block automation. Go/Python, strong networking, Prometheus/Grafana; hybrid in San Francisco.
About the Role
Join a team building the infrastructure behind a web data extraction platform for AI applications. You will own production systems that keep extraction fast and reliable against websites using sophisticated automated-access defenses.
What You'll Do
Architect and operate proxy rotation, IP and session management, and isolated egress infrastructure at scale.
Improve extraction success rates against websites that actively block automated access.
Build and maintain browser and TLS fingerprint management, CAPTCHA handling, and challenge-solving systems.
Monitor proxy-layer reliability and cost efficiency, and manage its operating economics.
Diagnose intermittent failures across the stack, implement durable fixes, and support systems in production.
What We're Looking For
More than 3 years of experience in adversarial web infrastructure, proxy-layer engineering, or web data extraction, with recent hands-on work in this area.
Production experience architecting proxy rotation, IP and session management, egress isolation, and proxy economics for third-party web extraction.
Experience bypassing major anti-bot defenses, such as Akamai, DataDome, Cloudflare, or Kasada, and owning extraction success-rate metrics.
Production experience with browser and TLS fingerprinting, CAPTCHA or challenge handling, and high-volume extraction against adversarial defenses.
Proficiency in Go and/or Python, plus strong networking fundamentals including TCP/IP, HTTP/2, connection pooling, and proxy orchestration.
Experience owning production systems end to end, including on-call, observability, and tools such as Prometheus and Grafana.
Compensation & Benefits
Base salary: $235,000 to $260,000 USD annually. Visa sponsorship is available.
Location
Hybrid role based in San Francisco, California, United States.
Skills
As published by ashby · 2 questions
Basics
Name, Email, Resume
Short answers (1)
- LinkedIn Profile URL optional
Pick from a list (1)
- Do you have work authorization for the country this role is based in? optional
