Software Engineer (Scheduler)
Posted Updated 3
views
Description
You will join a newly formed Scheduling team to own and extend the systems that allocate compute to complex machine learning workloads on Kubernetes. You will design scheduling systems for large-scale, topology-sensitive workloads, drive policies like gang scheduling and preemption, work with ML researchers, and build reliable custom Kubernetes controllers, operators, and CRDs.
Responsibilities
- Design, operate, and extend ML workload scheduling systems for batch inference and long-running training
- Implement scheduling policies such as gang scheduling, topology-aware placement, and preemption
- Collaborate with ML researchers and the Infrastructure team to troubleshoot bottlenecks and turn research requirements into platform capabilities
- Build reliable systems with clear failure semantics, runbooks, and SLOs
- Build and maintain custom Kubernetes controllers, operators, and CRDs
Requirements
- Practical experience building or operating cluster schedulers, batch systems, or queuing frameworks (e.g., Kueue, Volcano, Slurm)
- Deep hands-on Kubernetes experience including custom controllers, operators, and strong familiarity with the K8s scheduler
- Strong cloud infrastructure experience: compute provisioning, networking, Infrastructure as Code
- Solid foundation in DevOps/SRE best practices
- High proficiency in Python or Go
Benefits
- Hybrid working model
Skills
Sign in to read and join the discussion.