AI QA Engineer / LLM Test Engineer - 6 Months Contract
Summary
QA engineer role on a 6-month remote contract (extendable) focused on testing AI/LLM and Generative AI applications: prompt and response validation, hallucination detection, RAG evaluation and prompt regression, plus manual, API and Python-based automation testing with Selenium/Pytest. Work is done on UAE business hours.
Experience: 4 to 10 Years
Open Positions: 2
Contract: 6 Months (Extendable)
Work Mode: 100% Remote
Working Hours: UAE Business Hours
Joining: Immediate joiners or short notice preferred
Job Description:
We are looking for an experienced QA Engineer with hands-on experience in testing AI/ML-based applications, particularly LLM and Generative AI solutions.
Key Skills Required:
- Strong experience in manual and automation testing.
- Hands-on experience in testing LLM/GenAI applications, including prompt and response validation.
- Experience identifying hallucinations, validating response accuracy, consistency and relevance.
- Knowledge of RAG evaluation, source grounding and prompt regression testing.
- Experience with Python and automation tools such as , Selenium or Pytest.
- Familiarity with AI testing tools such as DeepEval, , or is an advantage.
- Good experience in API testing and defect tracking.
Important: Candidates must have actual project experience in AI/LLM testing. General QA automation experience without hands-on AI testing will not be considered.