Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Gemini, Cursor and Grok
Connect

True Talent Solutions Partners

NewBe an early applicant

Backend Infrastructure Engineer, Anti-Bot

Posted Updated
Discussion

Summary

Owns production anti-bot web-scraping infrastructure for AI data extraction (hybrid in San Francisco): proxy rotation and IP/session management, browser/TLS fingerprinting, and CAPTCHA handling to beat defenses like Cloudflare, Akamai, DataDome, and Kasada. Go/Python, strong networking, Prometheus/Grafana; $235k–$260k, visa sponsorship available.

About the Role

Join a team building web data-extraction infrastructure for AI applications. You will own production systems that keep high-volume extraction reliable when websites actively resist automated access.

What You'll Do

  • Architect and manage proxy rotation, IP and session management, and isolated egress nodes at scale.

  • Improve extraction success rates against websites with active anti-bot and anti-scraping defenses.

  • Build and maintain browser and TLS fingerprinting, CAPTCHA handling, and challenge-solving infrastructure.

  • Monitor the health and cost efficiency of the proxy layer.

  • Diagnose intermittent failures across the stack and deliver lasting fixes.

  • Own production systems end to end, including reliability and on-call responsibilities.

What We're Looking For

  • More than 3 years of experience in adversarial web infrastructure or proxy-layer engineering, with recent hands-on work in production web extraction.

  • Experience building proxy rotation, IP and session management, egress isolation, and proxy economics for third-party web extraction.

  • Production experience evading aggressive anti-bot defenses, including platforms such as Akamai, DataDome, Cloudflare, or Kasada, and ownership of success-rate metrics.

  • Experience with browser and TLS fingerprinting and CAPTCHA or challenge handling at production scale.

  • Proficiency in Go and/or Python, with strong networking fundamentals including TCP/IP, HTTP/2, connection pooling, and proxy orchestration.

  • Experience operating end-to-end production systems and implementing observability and on-call tooling such as Prometheus and Grafana.

Compensation & Benefits

Base salary: $235,000 to $260,000 annually. Visa sponsorship is available.

Location

Hybrid, San Francisco, California, United States.

Skills

Apply

See also

DevOps jobs by country — openings, pay and top skills →