Research Engineer, AI Evaluation & Agent Reliability
Posted Updated
Description
Mollkom in Riyadh is seeking a specialist in ML evaluation to design benchmarks for catalog, content, conversations and tool-use tasks, and to develop regression and adversarial tests.
You will analyze experiments, communicate findings clearly, and translate insights into engineering improvements. This hybrid role is based in Riyadh, Saudi Arabia.
Build benchmarks for catalog, content, conversations and tool-use tasks. Design rubrics and human/automated evaluation with agreement, bias and coverage analysis. Develop regression and adversarial tests for permissions and unsupported claims. Analyze experiments and model comparisons, communicating actionable findings and statistical limits. Experience in ML evaluation, applied research or AI quality engineering. Strong Python, data analysis and experiment design. Understanding of LLM-as-judge limitations, data leakage and evaluation bias. Ability to communicate results clearly and translate findings into engineering improvements.Skills
Sign in to read and join the discussion.