Agent Engineer

Summary

Design, build, and deploy Voice AI agents for clients, evaluate call quality against rubrics, and identify improvement opportunities for agent workflows.

About Us

Built with 💜 in KSA and leveraging Silicon Valley expertise, we’re creating innovative solutions in the realm of Voice AI and AI agents. As we continue our rapid growth trajectory in an exciting and dynamic market, we’re looking for A-players to join our team.

Role Overview

As an Agent Engineer, you will work closely with our engineering, product, and client-facing teams to design, build, and deploy AI agents that solve real-world problems. You'll support Proof of Concept (POC) development, own the end-to-end delivery of agent implementations, and interface directly with clients — gaining hands-on experience in one of the most in-demand areas of modern AI.

Key Responsibilities

  • Support the development of Proof of Concepts (POCs) for new client use cases, from scoping through to demo-ready delivery.

  • Design and build AI agents using our platform, translating client requirements into functional agent workflows.

  • Own end-to-end delivery of agent implementations — taking responsibility for timelines, quality, and outcomes.

  • Interface with clients to gather requirements, present progress, answer questions, and manage expectations throughout the project lifecycle.

  • Listen to recorded calls between AI agents and customers, evaluating each interaction for accuracy, tone, compliance, and customer experience.

  • Score conversations against a defined quality rubric and document findings in our QA tracking system.

  • Flag agent errors, hallucinations, missed customer cues, and policy or compliance issues for the team to address.

  • Identify patterns and trends across calls — recurring failure modes, common customer questions, and opportunities to improve agent prompts and workflows.

  • •Partner with the Operations team to share feedback that informs agent training, prompt updates, and product improvements.

  • Help refine and evolve the QA rubric and scoring guidelines as our agents grow and change.

  • Contribute to weekly quality reports summarizing performance metrics, key issues, and recommended improvements.

  • Occasionally review chat or text-based agent transcripts in addition to voice calls.

Requirements

  • Basic understanding of software testing concepts and methodologies

  • Familiarity with testing tools or programming languages is a plus

  • Strong attention to detail and problem-solving skills

  • Excellent communication and analytical abilities

  • Eagerness to learn and adapt in a fast-paced environment

  • Ability to speak and write fluently in both Arabic & English

  • Must be based in Riyadh

Why Join Us?

  • Opportunity to be part of a high-growth, innovative tech start-up

  • Collaborative, mission-driven culture

  • Hands-on experience working on impactful AI products

See also

AI Engineering jobs by country — openings, pay and top skills →

Tailor your CV for this role?

We couldn't check your fit for this role — add a CV to your profile to see it next time.

A new version of freehire is available