Sr. Staff Machine Learning Systems Engineer
Posted Updated 13
views
Summary
Leads the design, implementation, and scaling of ML evaluation systems, data pipelines, and statistical testing frameworks to ensure reliability and performance in healthcare-related AI systems.
- Build and scale data pipelines for ingestion transformation and dataset versioning
- Design adversarial and red team evaluation programs
- Design statistical regression testing methodology
- Implement labeling and calibration workflows
- Lead multi team initiatives for automated evaluation gates
- Mentor engineers and raise technical and statistical bar
- Own evaluation systems end to end
- Rearchitect evaluation and data pipeline systems for reliability
- Resolve cross team technical disagreements and drive alignment
- Set technical direction for evaluation metrics judge and scorer design
- Track and categorize evaluation failures over time
Perks/Benefits:
- 401k employer matching
- Company holidays
- Comprehensive health benefits
- Employee stock purchase program
- Offsite team retreats
- Parental leave
- Quarterly mental health days
- Unlimited PTO