Senior Software Engineer – AI Infrastructure

Design and build production infrastructure for AI agent systems, including high-performance Rust services for model inference, orchestration, and execution; scalable ML infrastructure and MLOps patterns; guardrails and observability; and reliable systems serving millions of users.

Responsibilities

• Design and build infrastructure for AI agent systems in production
• Develop high-performance Rust services for model inference, orchestration, and execution
• Architect scalable systems supporting millions of users and high request throughput
• Build ML infrastructure and MLOps patterns for model deployment, evaluation, and monitoring
• Define guardrails, observability, and failure handling for agent-driven workflows
• Optimize latency, throughput, and cost across inference and orchestration layers
• Translate experimental prototypes into hardened production systems
• Contribute to foundational infrastructure decisions in a high-scale, high-impact environment

Requirements

• 5+ years of experience building and operating high-scale production systems
• Strong proficiency in Rust and systems-level programming
• Deep understanding of distributed systems, reliability engineering, and performance optimization
• Experience operating services serving millions of users or high-throughput workloads
• Familiarity with ML infrastructure, model serving, or MLOps in production environments
• Experience designing observability, monitoring, and failure recovery systems
• Strong collaboration skills across infrastructure and applied engineering teams
• High ownership mindset in a high-stakes production environment