Software Engineer, Model Serving System

About the Role We're hiring a Software Engineer to join a fast‑moving, high‑ownership team building the next‑generation large language model (LLM) serving system. This role builds and optimizes the end-to-end path to get Microsoft AI (MAI)'s models running reliably in production through Microsoft Azure cloud platform. We work at the intersection of distributed model serving systems, inference engine optimization and integration, benchmarking, and evaluation to make MAI models shippable, measura…