QA Analyst

On behalf of our client, we are seeking a QA Analyst to join their team in Al Khobar.

The QA Analyst will play a critical role in executing and automating functional and non-functional testing for Generative AI-driven applications, ensuring that AI models, APIs, and user interfaces are reliable, scalable, and secure.

The role will cover end-to-end and integration testing, AI model and data validation, test automation, API testing, performance testing, and post-deployment testing.

The position requires strong hands-on experience in QA and test automation, with Python as a must-have and additional emphasis on Playwright, Pytest, SQL, and coding experience in Python.

Responsibilities:

• Execute end-to-end and integration testing to validate AI-driven actions and ensure products function according to specified requirements.
  
• Validate workflows, user journeys, API interactions, and AI model outputs against business logic.
  
• Conduct UI/UX testing to validate accessibility, responsiveness, and usability across devices and browsers.
  
• Support user acceptance testing activities.
  
• Validate input datasets for training, testing, and fine-tuning of AI models.
  
• Ensure data integrity, preprocessing workflows, and real-world alignment of synthetic data.
  
• Validate data pipelines and data flow between AI models, backend services, and frontend applications.
  
• Test models against predefined scenarios, including edge cases and adversarial inputs.
  
• Support performance, load, and stress testing using tools such as JMeter.
  
• Automate test cases for regression and frequent deployments.
  
• Validate new builds, releases, and updates continuously.
  
• Track defects, log issues, and verify fixes in collaboration with development teams.
  
• Monitor production model performance and analyse results for quality improvements.
  
• Implement test automation for functional and regression testing.
  
• Conduct API testing using Postman and SoapUI.
  
• Assist in security and compliance validation and ensure data protection and regulatory adherence.
  

Requirements

• 3–5 years of experience in quality assurance, with a focus on functional and integration testing.
  
• Playwright experience — mandatory.
  
• Pytest experience.
  
• Hands-on SQL experience.
  
• Hands-on coding experience in Python.
  
• Proficiency in test automation tools including Selenium, Cypress, and Robot Framework.
  
• API testing experience using Postman and SoapUI.
  
• Strong knowledge of AI model validation techniques and data integrity testing.
  
• LLM evaluation experience is a plus.
  
• Familiarity with performance testing tools such as JMeter.
  
• Security testing experience is an advantage.
  
• Experience working in Agile environments with CI/CD pipeline integration.
  
• Strong analytical skills with attention to detail in test execution and reporting.