Senior/Staff Software Engineer, ML Inference Platform
Summary
Build and maintain ML inference and compiler platforms for large language models, including observability, workflow pipelines, and continuous testing.
- Build observability for ML lifecycle tracking
- Design ML workflow pipelines for training optimization validation deployment
- Develop continuous testing and monitoring systems
- Maintain ML compiler platform for compile deploy validate on hardware platforms
- Maintain ML inference platform for large language models