Quality Engineer (QE) / SDET – AI Chatbot Validation
Posted Updated
Description
Astra-North Infoteck Inc. seeks a seasoned Quality Engineer (QE) / SDET to lead AI chatbot validation and automation efforts. You will design and implement tests across functional, integration, API, and AI-specific areas, defining quality strategies and data sets for reliable outcomes.
You will collaborate with DevOps and cross‑functional Agile teams, building scalable automation frameworks and embedding AI quality checks within CI/CD pipelines for deterministic and non‑deterministic AI behavior.
Partner with DevOps, Development, Product, and QE teams to design and execute exploratory, automated, and AI-focused tests. Define quality strategies, test plans, test cases, and test data for functional, integration, system, API, and regression testing. Design, develop, and maintain scalable test automation frameworks using Java, Python, or Groovy. Build automated tests for AI-enabled features, including chatbot response validation and latency checks. Validate AI integrations, APIs, microservices, data pipelines, model interactions, and third‑party services. Establish testing approaches for deterministic and non‑deterministic AI behavior with evaluation datasets and quality thresholds. Integrate automated testing and AI quality checks into CI/CD pipelines with DevOps teams. Identify, document, and track defects through resolution; report quality metrics and risks. 5+ years in Quality Engineering, QA, test automation, or software development. 5+ years programming experience in Java, Python, Groovy, or similar. 5+ years building and maintaining test automation frameworks. Experience testing AI or ML-powered apps, chatbots, or generative AI features. Hands-on with Selenium, Cucumber/Gherkin, Playwright, RestAssured, or similar tools. Experience with API, database, microservice, and regression testing. Familiarity with JUnit, TestNG, ReadyAPI, and JMeter in testing environments. Understanding of TDD/ATDD/BDD and continuous testing practices. Knowledge of AI quality concepts: prompt evaluation, accuracy, bias, hallucinations. Ability to create AI evaluation datasets and effective test data.Skills
Sign in to read and join the discussion.