Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

Plaud Inc.

AI Systems QA Engineer for LLM & Automation

Posted Updated

Description

Plaud Inc. is seeking a QA Engineer to own end-to-end testing of a large server-side architecture and AI-powered features. You will evaluate AI systems, implement automated quality gates, and build testing tools integrated with CI/CD to ensure robust product delivery.

The role focuses on regression, performance, and data integrity across user management, billing, and AI components, driving high-quality releases in a fast-moving, product-driven environment.

Server-Side & Architecture QA Full-Lifecycle Testing for core server modules (e.g., user management, billing). Migration safeguards: lead API regression, data-consistency checks, and service-degradation drills during architecture upgrades. AI System & Algorithm Evaluation: AI Search & Recs; design quality gates for Retrieval/Memory systems, long-tail recall, and embedding drift. AI Infra & Model Release: drive testing for Context OS through capacity assessment and chaos drills; build automated quality gates for model releases. AI Agent Testing: formulate automated evaluation for AI Agents, covering multi-turn dialogue, tool calling, and error recovery. Test Engineering & Automation Tool Development: independently develop and roll out custom automated testing tools based on business needs. Scripting & CI/CD: rapidly produce automation/performance scripts and integrate Agent testing pipelines into CI/CD. Experience testing large server-side architecture refactors, microservices, and messaging queues. Experience testing LLM/Embedding/RAG/Agent products; familiar with vector-retrieval systems (Elasticsearch/Faiss/Milvus) and inference frameworks (vLLM/Triton). Familiar with automation frameworks (Selenium/Playwright/Pytest) and Kubernetes/Docker; established QA methodology for AI products. ESOP High-Impact Environment AI Tools Access Top-spec Equipment Team Offsites Medical Insurance

Skills

Apply

See also

AI Engineering jobs by country — openings, pay and top skills →