ML Engineer - LLM Evaluation & Automation
Summary
Designs and builds automated evaluation pipelines for LLM outputs, creating metrics to measure accuracy, relevance, and consistency and driving continuous model improvements.
We are seeking a highly skilled Machine Learning Engineer who specializes in leveraging Large Language Models (LLMs) for automated evaluation and quality assessment. In this role, you will design and build systems that automatically measure and improve the accuracy, relevance, and consistency of model outputs. You will lead initiatives to create evaluation pipelines, develop metrics, and deliver actionable insights for continuous improvements. This position requires strong technical expertise, …