Software Development Engineer - AI/ML Networking Disaggregated Inference, Annapurna Labs , Elastic C
Posted 6
views
Annapurna Labs Inc. Software Development Engineer - AI/ML Networking Disaggregated Inference, Annapurna Labs , Elastic C
Summary
SDE role on Annapurna Labs' team building the network layer for disaggregated LLM inference — splitting model serving into separate prefill and decode stages so data reaches accelerators efficiently at scale. Day-to-day work centers on AI/ML networking software and optimizing accelerator-to-accelerator data movement.
Job Description Every token a large language model generates depends on data reaching the right accelerator at the right moment. As AI models outgrow any single chip, the network between accelerators becomes the bottleneck that decides how fast — and how affordably — the world's largest models can serve real users. That network layer is what our team builds.\n \n \nWe're looking for an engineer to work at the frontier of disaggregated inference: splitting LLM serving into separate prefill and d…
