Automation QA Engineer with AI
Posted Updated
Summary
Six-month contract role in Alpharetta, GA designing and executing tests for LLM-powered conversational agents: building evaluation frameworks for LLM quality, automating API/UI testing with Python/JavaScript (Pytest, Selenium), creating regression suites for agentic outputs, and driving quality metrics with Jira.
Automation QA Engineer with AI Alpharetta, GA 6 Months Experience: 10 years Tech Stack: Python/JavaScript, Test Automation, Pytest/Selenium, LLM Evaluation, Jira/Test Management Job Description: Design and execute test cases for multi-turn agent conversations . Build evaluation frameworks to assess LLM quality . Automate API and UI testing . Create regression suites for agentic outputs. Drive test coverage and quality metrics. Develop automated testing frameworks using Python/JavaScript, Pytest…
What they ask for
Required
- 10 years of experience
- Python and JavaScript
- Test automation with Pytest/Selenium
- LLM evaluation experience
- Jira/Test management
- Design and execute test cases for multi-turn agent conversations
- Build evaluation frameworks to assess LLM quality
- Automate API and UI testing
- Create regression suites for agentic outputs
- Drive test coverage and quality metrics