Senior Software Engineer Dev Platform

You will build AI Gateway integrations, routing policies, budgets, rate limits, reporting, APIs, SDKs, and self-service tools. You will migrate LLM workloads, implement security controls and observability, operate reliable production features, and support internal users with documentation and debugging.

Responsibilities

• Build and extend AI Gateway integrations and routing policies
• Design APIs, SDKs, and self-service developer tooling
• Migrate LLM workloads to the gateway
• Implement access control, key management, and audit logging
• Instrument latency, errors, token usage, and cost
• Own production features from design through operation
• Document and debug the platform for internal users
• Contribute to code review and engineering practices

Requirements

• Backend engineering
• Platform engineering
• API
• Distributed system
• Rust
• Python
• TypeScript
• LLM API
• Observability
• CI/CD
• Container
• Kubernetes
• Cloud computing
• API design