Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

Handoff

NewBe an early applicant

AI Engineer São Paulo Engineering

Posted Updated

Who recruits here Pro

Up to three recruiters at Handoff with their work email, so you can write to a person.

View plans

Part of Pro. How it works

Summary

Owns the quality, speed and cost of Handoff's AI in production across its products — investigating degradations, running experiments on prompts, models and agents, and building evals and observability. Core stack: Python with TypeScript/Node, SQL, cloud architectures, agent frameworks like LangGraph and tracing tools like LangSmith/Langfuse.

Handoff is seeking an AI Engineer to own how well our AI performs in production, across all products, focusing on quality, speed and cost. You will investigate degradations, run experiments, and ship improvements driven by data.

Most work centers on experimentation—formulating hypotheses, testing against eval data and real traffic, and delivering data-supported results that delight customers and reduce costs.

Own our core AI metrics and the dashboards and alerts behind them. Run experiments on prompts, tools, context and models, from offline evals to controlled rollouts, and decide with data. Build the evals and observability that let the whole team ship AI changes safely. Improve what customers judge us on: accurate outputs, reliable actions and fast answers. Shape the architecture of our agents as the product grows: how context, tools and memory scale. Evaluate new models and providers as they are released, and lead migrations when they are worth it. Work across Handoff’s products and teams, wherever AI quality, speed or cost needs attention. Turn customer-reported AI problems into diagnosed causes and measurable fixes. Share what you learn and raise the bar for AI engineering across the team. Owned an LLM-powered feature or agent in production and can point to a metric moved. Designed experiments carefully and can distinguish real improvement from noise. 5+ years of software engineering experience, with strong Python and working knowledge of TypeScript/Node, SQL and cloud-based architectures. Practical experience with agents: tool calling, context management, retrieval and structured outputs, ideally with a framework such as LangGraph. Experience building evals and using tracing tools such as LangSmith, Langfuse or similar. Comfort with ambiguity and switching between problems, and you set your own agenda from the data. You care whether the output is right for the customer, not only whether the model call succeeded. Competitive salary in USD stock options Unlimited PTO Relocation allowance Top-notch equipment Team offsites around the world

Skills

Apply

See also

AI Engineering jobs by country — openings, pay and top skills →