Lead Software Engineer - LLM Ops Platform Reliability
Summary
Build and operate scalable LLM serving infrastructure using cloud and Kubernetes, ensuring reliability and performance for AI systems in production.
hackajob is collaborating with J.P. Morgan to connect them with exceptional professionals for this role. JOB DESCRIPTION Help shape how AI systems run reliably in production at scale. In this role, you'll build and operate large language model serving infrastructure, bringing strong engineering fundamentals and site reliability practices to cutting-edge AI platforms. You'll work hands-on with cloud and Kubernetes-based deployments, deep observability, and cost-aware performance tuning. If you e…