AI Test Lead
Description
Job Title: SDET / AI Test Lead
Location: Bellevue, WA or Overland Park, KS or Frisco, Tx (on-site)
Duration: Fulltime Permanent
Job Description
SDET
Must Have Technical/Functional Skills
Ø 6+ years of experience in designing, developing, and maintaining automation frameworks for Web, Mobile, and API testing.
Ø Strong programming skills in Core Java, including OOPs concepts, Collections Framework, Exception Handling, and Multithreading.
Ø Hands-on experience in test automation using Selenium WebDriver, Playwright, and Appium frameworks.
Ø Experience in API automation testing using REST Assured, Postman, Bruno, Swagger/OpenAPI, and related tools.
Ø Experience in implementing and maintaining CI/CD pipelines using Jenkins, GitHub Actions, Azure DevOps, or GitLab CI/CD.
Ø Proficiency in test management and defect tracking tools such as qTest, Jira, Confluence, ALM, and Zephyr.
Ø Hands-on experience using LLMs (GPT-4, Claude, Gemini, Llama, Mistral, etc.) for:
o Test case generation
o Test script generation and optimization
o Test data creation
o Requirement analysis and test coverage improvement
o Defect analysis and root cause identification
Ø Experience in generating manual test cases and automated test scripts using Java, Python, Selenium, Playwright, and AI-assisted development tools.
Ø Strong prompt engineering skills, including designing effective prompts to improve the accuracy and relevance of LLM-generated outputs.
Ø Experience working with AI orchestration frameworks such as LangChain, LangGraph, LlamaIndex, Semantic Kernel, or similar technologies.
Ø Knowledge of Retrieval-Augmented Generation (RAG), Vector Databases, Embeddings, and AI Agent concepts.
Ø Experience integrating AI and automation solutions with enterprise tools through APIs, including Jira, Confluence, qTest, etc.,
Strong analytical, debugging, and problem-solving skills with the ability to identify automation opportunities and drive quality engineering initiatives.
Roles & Responsibilities
Ø Design, develop, and maintain scalable automation frameworks for Web, Mobile, and API testing.
Ø Ensure high test coverage through automated functional, regression, integration, and end-to-end testing.
Ø Design and execute API test suites for REST and microservices-based applications.
Ø Validate request/response payloads, authentication, data integrity, and service integrations.
Ø Automate API testing using tools such as REST Assured, Postman, Bruno, and Swagger/OpenAPI.
Ø Leverage LLMs (GPT, Gemini, Claude, Llama, etc.) to generate:
o< span style="white-space:pre"> Test scenarios and test cases
o Automation scripts
o Test data
o Requirement-based test coverage
o Defect summaries and RCA insights
Ø Build and optimize prompts to improve the quality and accuracy of AI-generated test artifacts.
Ø Evaluate AI-generated outputs and ensure compliance with testing standards and business requirements.
Ø Identify opportunities to accelerate testing activities using GenAI tools and frameworks.
Ø Build solutions that connect AI services with enterprise tools such as Jira, Confluence, qTest, GitHub, and ServiceNow through APIs.
Education: Bachelor's degree
Skills
- AI
- API
- API Testing
- Appium
- Authentication
- Automation
- Azure
- Azure DevOps
- CI/CD
- Confluence
- DevOps
- Embeddings
- Generative AI
- GitHub
- GitHub Actions
- GitLab
- Java
- Jenkins
- Jira
- LangChain
- LangGraph
- LlamaIndex
- LLM
- Microservices
- Mistral
- Multithreading
- OpenAPI
- Playwright
- Postman
- Prompt Engineering
- Python
- RAG
- REST Assured
- Selenium
- Semantic Kernel
- ServiceNow
- Swagger
- Test Automation
- Vector Databases
Sign in to read and join the discussion.