Senior Test Automation Engineer (AI Systems)

About Gramian

Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.

About the Role

Our client is a Big4 Consultancy group that works with leading financial institutions on AI-driven transformation, automation, advanced analytics, and financial crime prevention. Their work spans intelligent fraud detection, AML/KYC modernization, autonomous workflows, enterprise AI platforms, and the secure industrialization of AI in highly regulated environments.

We are looking for a Senior Test Automation Engineer to design and execute automated testing strategies for complex AI-enabled applications. The role spans API testing, frontend automation, backend data flows, system integration, performance testing, and validation of LLM outputs and prompt behavior.

CONTRACT: Contractor assignment, expected October 2026 – July 2027, with potential extension

COMMITMENT: Full-time

LOCATIONS: Europe-based, preferably CEE; remote, with potential future hybrid work in Prague

PROCESS: Initial qualification followed by technical and client interviews

NOTES: Fluent English is required.

Responsibilities

• Design and maintain comprehensive automated testing strategies across frontend, backend, APIs, and data flows.
• Build and maintain automated test suites using Selenium, Playwright, Cypress, or comparable frameworks.
• Develop test approaches for validating LLM prompts, model outputs, consistency, and hallucination behavior.
• Execute system integration, regression, and end-to-end testing.
• Perform performance and load testing before production releases.
• Validate that automated workflows meet defined business rules and performance SLAs.
• Investigate defects, document reproducible bug reports, and support root-cause analysis.
• Collaborate closely with developers and platform teams on issue resolution.
• Maintain reliable regression coverage across evolving application releases.
• Contribute to test standards, quality gates, and release-readiness criteria.

Requirements

• 5–10 years of professional QA, test automation, or software testing experience.
• Strong hands-on experience with Selenium, Playwright, Cypress, or similar automation frameworks.
• Proven experience testing complex web applications, APIs, and backend integrations.
• Experience designing and executing end-to-end, regression, and system integration tests.
• Hands-on experience with performance or load testing.
• Strong ability to investigate failures, identify root causes, and document defects clearly.
• Experience integrating automated testing into CI/CD pipelines.
• Fluent professional English.