Senior software engineer on Cisco IT's internal Foundational Model Service: serving small, large, and embedding models on Kubernetes with vLLM, NVIDIA NIM, and similar runtimes. Day to day involves runtime tuning, GPU/accelerator optimization, model evaluation and release gating, platform APIs and tooling, and on-call reliability. Core stack: Python/Go, Kubernetes, IaC, Prometheus/Grafana.
Sign in to see your match