freehire launches on Product Hunt on 26 August.

Follow →

Senior Lead Software Engineer - LLM Ops Platform Reliability

Summary

Build and operate scalable LLM serving infrastructure using Kubernetes and cloud platforms, applying SRE practices to ensure reliable AI system performance in production.

Description Help shape how AI systems run reliably in production at scale. In this role, you'll build and operate large language model serving infrastructure, bringing strong engineering fundamentals and site reliability practices to cutting-edge AI platforms. You'll work hands-on with cloud and Kubernetes-based deployments, deep observability, and cost-aware performance tuning. If you enjoy solving hard production problems and making platforms measurably better, you'll find meaningful impact a…

See also