Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

Alpha10x

NewBe an early applicant

Senior AI Evals Engineer

Posted

Description

ALPHA10X in Doha seeks a Senior AI Evals Engineer to make AI quality measurable. You own evaluation across the platform: datasets, metrics, judges and pipelines, converting results into decisions that improve models and deployments.

Reporting to the Head of Engineering, you shape evaluation standards, build scalable pipelines, and collaborate with AI engineers, data scientists, Product and Solutions to raise the bar across the company.

Define evaluation strategy and frameworks for AI systems, including benchmarking. Design and maintain evaluation datasets reflecting real usage and edge cases. Integrate evals into delivery workflow and monitor production for quality drift. Collaborate with AI engineers, data scientists, Product and Solutions; report clearly. Master’s degree in computer science or engineering. 7+ years in ML engineering, applied science, or software with AI in production. Hands-on ownership of evaluation for LLM or ML systems in production. Strong knowledge of offline and online evaluation, A/B testing and related methods.

Skills

Apply

See also