Senior Inference Platform Engineer — Kubernetes & Latency
Summary
Senior engineer building and optimizing AI inference services on Kubernetes, focusing on low-latency performance and system reliability.
A cloud service provider is seeking a Senior Software Engineer II for their Inference team in Sunnyvale, California. In this role, you'll lead design reviews, implement optimizations, and improve service reliability. The ideal candidate has extensive experience with distributed systems, strong Python/Go skills, and Kubernetes expertise. This position offers a competitive salary between $165,000 to $242,000, plus generous benefits and a hybrid working environment.