Engineering Manager Provider Ecosystem

You will lead and grow engineers while remaining hands-on in code reviews and incident response. You will own provider adapters, endpoint lifecycles, and routing; launch new providers; expand multimodal inference capabilities; and use benchmarks, evaluations, and telemetry to improve routing and provider quality.

Responsibilities

• Lead, hire, and grow engineers
• Set the team roadmap and advocate for the team with leadership
• Remain hands-on in code reviews and incident response
• Own provider adapters, endpoint lifecycles, and routing
• Serve as the technical counterpart for provider partners
• Run day-zero and stealth provider launches
• Coordinate with GTM, business development, and legal to onboard providers
• Lead expansion into image, video, audio, embeddings, realtime, and batch inference
• Own evaluations and inference quality
• Use evaluation data and production telemetry to inform routing decisions and provider feedback

Requirements

• 4+ years of engineering management experience, including building or scaling a team during rapid growth
• Distributed systems expertise
• API design expertise
• LLM inference expertise
• Knowledge of streaming, tool calling, prompt caching, quantization, throughput, and latency trade-offs
• Experience routing high request volumes across heterogeneous endpoints
• Hands-on coding experience
• Experience using AI-assisted development tools
• Ability to negotiate technical integrations with model labs and providers
• Experience with benchmarks, evaluations, and production telemetry
• Ability to recruit and retain engineers
• Clear communication and cross-functional leadership

Benefits

• Equity