GenAI Test Automation Engineer
Summary
Build and maintain automated test frameworks for GenAI products using Python and Playwright, validating AI outputs, APIs, databases, and ETL pipelines in regulated environments.
We are looking for a Senior QA Automation Engineer to help build and validate enterprise-scale GenAI products. The ideal candidate combines strong automation skills with experience in API, database and ETL testing and understands how to validate AI-powered applications in regulated environments.
What you will do:
Design and develop automated testing solutions for GenAI products
Build and maintain scalable test frameworks using Python and Playwright
Design, implement and execute WebUI and API test automation
Create validation strategies for AI-powered applications and GenAI workflows
Validate AI-generated outputs, data quality and end-to-end business processes
Develop and execute automated testing for database integrations and ETL processes
Create SQL-based validation scenarios to ensure data consistency and integrity
Collaborate with engineering and product teams to improve quality, reliability and test coverage
Contribute to automation and quality engineering best practices across the software development lifecycle
What we are looking for:
5+ years of experience in Test Automation Engineering, QA Automation or SDET roles
Strong proficiency in Python
Hands-on experience with Playwright
Experience with WebUI test automation
Experience with API testing and automation
Strong understanding of databases and database testing
Strong SQL skills
Experience validating ETL processes, data pipelines or complex data workflows
Extensive validation experience, preferably in regulated industries such as Pharma, Healthcare, Banking or Financial Services
Experience building automated testing solutions across UI, API and data layers
Understanding of AI-powered applications, GenAI products or AI-assisted testing approaches
Strong analytical and problem-solving skills
Experience testing LLM- or AI-based applications
Ability to collaborate effectively in cross-functional and international teams
Nice to have:
Experience with AWS and cloud-based testing environments
Experience with Apache Airflow
Neo4j
Postman
Cypher / OpenCypher
MCP (Model Context Protocol)
AWS Bedrock
Knowledge of data quality or machine learning validation practices
Perks and benefits:
Comprehensive benefits - enjoy Udemy for Business, private medical care, Multisport card, veterinary package, language lessons, and shopping vouchers.
Flexibility - adaptable working hours and remote/hybrid work options to suit your lifestyle & location.
Career growth - access opportunities for professional development and learning, including perks related to our official partnerships with global IT giants: Microsoft, AWS, Snowflake, Salesforce & more.
Global collaboration - work with a diverse, international team.
Innovative environment - be part of a forward-thinking and growth-oriented workplace.
Engaging community – Work with passionate professionals and participate in team-building events, hackathons, and CSR initiatives to make an impact beyond work.
Team-building events including our company tradition (annual company event in Mazury).
A pleasant surprise to start your journey with us in the form of a welcome pack.
Sounds interesting? Click "Apply" and have a chance to hear more!