Backend Engineer: Scalable Rust/C++ API for AI Inference
Summary
Backend engineer building and operating scalable model-serving infrastructure for AI inference, working primarily in Rust or C++ with distributed systems. Day to day spans API design, deployment, observability, and scaling for high-throughput, low-latency serving.
SpaceXSI is seeking a backend engineer to build and operate scalable production infrastructure for model serving. You will work primarily with Rust or C++, focusing on high-throughput inference, low latency, and reliability across distributed systems. Familiarity with Docker, Kubernetes, and gRPC will be highly beneficial.
You will own end-to-end responsibilities from API design to observability and scaling, ensuring robust deployment of billions of tokens per minute for developers worldwide.