Senior Data Analyst
Posted Updated 6
views
Summary
A senior individual-contributor data analyst who owns observability, evaluation, and quality measurement of Rightsline's LLM-powered features. Day to day they instrument the LLM stack (traces, prompts, tool calls, latency, token spend, output quality) and build evaluation suites to gauge product impact.
Reporting to the SVP Engineering, the Senior Data Analyst – LLMOps will work with the Application Development team to own the observability, evaluation, and quality measurement of Rightsline’s LLM-powered features. This is a senior individual-contributor role in which you will instrument the LLM stack end to end — traces, prompts, tool calls, latency, token spend, and output quality — build the evaluation suites that tell us whether a change made the product better or worse, and turn that telem…