Title: AI Quality Manager / QA Lead (German C1+)
Posted
Summary
QA lead for an AI-first insurtech venture (built with Alteos, backed by AXA): owns the AI testing strategy, defines what 'correct' means for German-language AI insurance answers, and manages a freelance tester pool. Requires C1 German, daily LLM tooling use, and QA/test-management leadership experience.
Compensation: $48k – $68k
We are building an AI-first insurance venture together with the Alteos team, backed by AXA. Our customer-facing flow (quote, advice, purchase) is fully AI-driven and live, and a second track automates internal insurance operations with AI. Small team, startup speed, decisions made in-house.
Must have
- German at C1 level or higher (the product, data and insurance policies are in German)
- Daily use of tools like Claude Code or ChatGPT, and an understanding of how LLM products behave and fail
- Experience organizing people and distributing work (QA lead, test manager or similar)
- Startup experience
- Strong self-organization across parallel tracks and constant change
- You own every conclusion you present, AI-assisted or not, and can explain it in a few sentences
Nice to have
- Insurance background (claims, underwriting, policy wording, customer service or product at an insurer, broker or insurtech). You will judge whether AI answers about insurance are correct, so domain knowledge counts a lot
- You built or ran an AI evaluation setup yourself (golden answer sets, LLM-as-judge, regression testing)
- Technical background (semi-technical is enough)
What you will do
- Own the AI testing strategy: what gets tested, why, and to what depth
- Define what "correct" means for our AI answers and turn it into clear evaluation criteria
- Organize test sets across many parallel variations (often 50 at once)
- Review and mark AI outputs, and define how manual testers evaluate them
- Brief, distribute and check the work of the freelance tester pool
- Report clearly what is broken, how bad it is, and what must be fixed before release