Test Engineer | AI Functionality

About the Role

We’re looking for an experienced Test Automation Engineer who has high aptitude, is passionate about quality engineering, and is excited by the challenge of testing generative AI capabilities.

This is a hands-on, build-focused role where you will design and build automated test frameworks from scratch for the greenfield RCP Platform, alongside performing exploratory testing. Sitting within a tight-knit, cross-functional Digital Team (product, engineering, data, and AI working together), you will step in as the primary technical QA, owning the end-to-end testing strategy, closing quality gaps, and solving genuinely novel testing problems around AI-enabled features.

What You'll Be Doing

• Define & Own the QA Strategy: Own the testing automation suite and functional testing strategy for the greenfield RCP Platform, setting quality standards and test processes from scratch.

• Build End-to-End Automation Frameworks: Build and maintain automated test coverage across unit, integration, and E2E layers using Vitest and Playwright.

• Validate Generative AI Features: Design and build a dedicated testing framework for AI capabilities—including Claude API integrations, prompt evaluation, edge-case validation, structural JSON compliance, and non-deterministic response verification.

• Embed QA in the Sprint Cycle: Integrate directly into the development workflow, working alongside developers during refinement to ensure testability is built in from day one rather than bolted on.

• Database & API Coverage: Perform API testing and close backend testing gaps across the platform, including Supabase/Postgres and Row Level Security (RLS) policies.

• Accelerate with AI: Leverage modern AI coding assistants and automation toolsets to speed up test suite creation and maintenance.

• Collaborate & Communicate: Flag quality risks and technical debt early in stand-ups, articulating technical choices and trade-offs clearly to developers and leadership.

What We're Looking For

• 5+ Years Experience: Minimum 5 years in QA or test engineering with hands-on experience building automated test suites from scratch in a modern web stack.

• Hands-on AI/LLM Testing: Applied, non-theoretical experience testing generative AI features, prompt-based behaviors, and non-deterministic outputs using validation logic rather than exact string matching.

• Core Automation Stack: Deep, practical expertise using Playwright with TypeScript (E2E) and Vitest (unit/integration).

• Backend & API Mastery: Solid experience in API testing/mocking, database testing (Supabase/Postgres, RLS), and CI/CD pipeline integration (GitHub Actions).

• Greenfield Ownership & Aptitude: Strong aptitude and a proven track record operating independently in fast-paced environments with ambiguous requirements, taking immediate initiative without waiting to be told.

• Clear Communication: Meticulous attention to detail with direct, structured, and pragmatic communication skills to advocate for quality across the SDLC.

Nice to Have

• Experience defining end-to-end QA processes within a fast-scaling or startup engineering team.

• Deep experience executing exploratory and manual testing alongside automated suites to catch edge cases others miss.

What's on Offer

• Greenfield Ownership: Build a modern QA framework from the ground up on a core platform without inheriting legacy technical debt.

• Innovative AI Work: Tackle novel, unsolved testing challenges around LLMs and Claude API integrations.

• Collaborative Environment: Join an agile, office-first digital team where product, engineering, and AI sit together.

• Central Location: Modern offices located in Auckland CBD.

Please Note: Applicants must have the right to work in New Zealand and be comfortable working in an office-first culture located in Auckland CBD.