freehire launches on Product Hunt on 26 August.

Follow →

Senior/Staff Software Engineer - Conversational AI

Summary

Build and lead production-grade conversational AI agents using LLMs, RAG, and guardrails, while owning the full stack and cloud infrastructure in a hands-on leadership role.

We're building production conversational AI — LLM agents that hold real conversations at scale, answer from a grounded knowledge base, and know their limits. We're looking for a hands‑on Lead AI Engineer to own it end to end: the AI behavior, the infrastructure, and the full stack around it.

We're a small, focused team tackling a big problem — making AI that's accurate, grounded, and trustworthy in production. That means high ownership, fast decisions, and direct impact: what you build ships and runs live.

This is a builder‑leader role. You write code, make the architecture calls, and set the technical direction for the team.

What you'll do

  • Own the AI system — LLM agents, retrieval‑augmented generation (RAG), and guardrails. Drive answer quality, retrieval relevance, and safe behavior.
  • Debug and improve AI behavior — diagnose why a model hallucinated, mis‑routed, or responded incorrectly, and design evaluations (LLM‑as‑judge and others) to measure and prevent it. Turn vague “it answered badly” reports into measured fixes.
  • Lead platform engineering — design and ship the services, data pipelines, and tooling that let the product scale reliably.
  • Own infrastructure as code — Terraform across multiple environments, CI/CD, and a server‑less cloud footprint.
  • Build full‑stack — backend services, an internal web app, and data‑processing pipelines.
  • Own security and data protection — treat it as first‑class: data isolation, least‑privilege access, encryption, careful handling of credentials and sensitive user data. Security is a core requirement of everything we ship, not an afterthought.
  • Set technical direction — review designs and code, define quality bars, and keep production healthy.

Must have

  • You've shipped an LLM application to production — agents and/or retrieval‑augmented generation (RAG), with guardrails and a vector/embeddings layer. Not just prototypes.
  • Strong prompt engineering and AI debugging — you can reason about model behavior and build evaluations to measure it.
  • Terraform / infrastructure as code and solid AWS depth (serverless compute, NoSQL, event‑driven flows, IAM).
  • Full‑stack engineering — TypeScript/Node, a modern web framework (React/Next.js), and Python for data work.
  • Strong security and data‑protection fundamentals — you build systems that handle sensitive user data safely: data isolation, least‑privilege access, encryption, and secrets management.
  • Ownership and technical leadership — able to lead a project and keep a production system reliable.

Nice to have

  • Experience with Amazon Bedrock (agents, knowledge bases, guardrails) — a strong advantage.
  • SaaS / multi‑tenant platform design.
  • Production observability and cost optimization for AI workloads.

What success looks like

  • The AI answers more questions correctly and grounded, and stays within its limits — measured, not guessed.
  • The platform scales smoothly, with safe and repeatable infrastructure changes.

See also

Tailor your CV for this role?

We couldn't check your fit for this role — add a CV to your profile to see it next time.

A new version of freehire is available