Senior ML Engineer - (NPW)
Posted Updated 2
views
Role summary
Owns the AI Evaluation and Benchmarking Baseline: eval set construction aligned to the golden dataset, and accuracy measurement harness automation.
Key responsibilities
- Construct the evaluation set aligned to the golden dataset
- Automate the accuracy measurement harness
- Integrate MLflow for experiment tracking
- Own KPI observability reporting
Required skills & experience
- 5+ years ML engineering experience with an evaluation / observability focus
- Hands-on experience with MLflow or an equivalent experiment-tracking tool
- Benchmarking framework design experience, including KPI reporting for stakeholder review
- Strong Python skills
Preferred qualifications
- Experience resequencing an eval milestone around a late-arriving dataset dependency
- KPI observability reporting experience for AI systems specifically
Education
B.Tech/MCA in Computer Science, AI/ML, or a related field, or equivalent practical experience.
