Senior Model Engineer (RL Inference)
Posted Updated
Description
- The RL infrastructure team is looking for an engineer to help with low precision RL training and inference
- Design and optimize our inference stack for all shapes of RL workloads at xAI, from small scale ablations to production training runs
- Analyze, profile and address performance bottlenecks in large scale RL systems
- Work closely with the modelling team to efficiently implement novel RL techniques and algorithms
Benefits
- Health and wellness: Comprehensive health insurance including medical, dental, vision, and disability coverage
- Life and family: Life and AD&D insurance and fertility benefits to ensure our team’s well-being and peace of mind
- Flexible vacation: We work hard but avoid burn out. Take time off when you need it
- Visa sponsorship: We support international talent with visa sponsorship to join our team
- 401(k) plan: Retirement savings plan to secure your financial future
- Experience writing production-quality code in Python, PyTorch, JAX, Rust, or C++
- Experience training large models (e.g., pre-training, post-training, fine-tuning, or RL training of neural networks with 1B+ parameters)
- Experience in LLM inference
- Experience in building, debugging, and optimizing efficiency of large-scale distributed systems
- Experience in developing inference engines, e.g. SGLang, vLLM
- Strong knowledge in quantization and numerics in LLM inference and training
- Willingness to dive deep and solve hardcore problems at all levels of the stack
Skills
Sign in to read and join the discussion.