Senior Lead Software Engineer - LLM Ops Platform Reliability
Summary
Build and operate LLM serving infrastructure at scale, applying SRE practices to cloud and Kubernetes deployments with deep observability and cost-aware tuning.
hackajob is collaborating with J.P. Morgan to connect them with exceptional professionals for this role. JOB DESCRIPTION Help shape how AI systems run reliably in production at scale. In this role, you'll build and operate large language model serving infrastructure, bringing strong engineering fundamentals and site reliability practices to cutting-edge AI platforms. You'll work hands-on with cloud and Kubernetes-based deployments, deep observability, and cost-aware performance tuning. If you e…