QA Engineer | Barcelona
Posted Updated
Description
TransPerfect Translations International is seeking a QA Engineer to own automated testing for web, API, and AI-enabled products within the TechOps team. You will design and maintain tests, perform exploratory and regression testing, and collaborate with distributed teams to ensure release readiness.
You will work with Playwright or Selenium, contribute to AI-enabled test strategies, and help validate AI/LLM features, including translation outputs, while integrating tests into CI/CD pipelines for
Design, implement, execute, and maintain automated functional, integration, regression, and API tests for web and mobile-enabled applications Build and improve scalable, maintainable test automation frameworks using Playwright, Selenium, or comparable tools, with appropriate code reviews and quality checks Integrate automated tests into CI/CD pipelines, analyze failures, reduce flaky tests, and provide timely feedback on release quality Create risk-based test strategies, test plans, test scenarios, and traceable test cases aligned with user stories and acceptance criteria Perform hands-on exploratory, cross-browser, system, end-to-end, database, and RESTful API testing as needed Validate data integrity, access control, error handling, usability, and compatibility across supported environments Identify, document, prioritize, and track defects in Azure DevOps or comparable tools, supplying clear steps, evidence, impact, and technical findings Work with developers, product managers, QA leads, and release managers to assess risks, investigate defects, and support release-readiness decisions Test AI-powered features and LLM-based workflows for functional correctness, output quality, reliability, and alignment with requirements Evaluate AI-generated language and translation outputs using defined criteria such as meaning preservation, terminology, fluency, formatting, and locale conventions; collaborate with language specialists when subject-matter review is needed Design repeatable AI test scenarios and evaluation datasets covering normal, edge, ambiguous, multilingual, and adversarial inputs Identify and document AI-specific failures, including hallucinations, omissions, inconsistent responses, bias, unsafe outputs, and failures to follow instructions or required formats Account for non-deterministic AI behavior by using appropriate evaluation rubrics, comparative baselines, sampling, and repeat testing rather than relying on exact-text assertions alone Use approved AI assistants to accelerate test-case design, test-data preparation, automation scripting, coverage analysis, debugging, and defect reporting; independently verify all AI-generated artifacts Assess the risks of AI-assisted testing workflows, including sensitive-data exposure, unsupported assumptions, fabricated test evidence, and weak assertions; follow company security and data-handling policies Maintain test assets and technical documentation, and proactively recommend improvements to test coverage, effectiveness, and execution efficiency Bachelor’s degree in Computer Science, Engineering, or equivalent. Professional experience in software quality engineering with manual and automated testing. Hands-on experience developing and maintaining UI or API automation using Playwright, Selenium, or similar frameworks. Programming proficiency in C#, Java, or a comparable language used for test automation. Experience with RESTful API testing, debugging, test-data management, and validation of backend behavior. Experience working with CI/CD platforms and defect/test management tools such as Azure DevOps, TeamCity, or Jira. Ability to analyze requirements, develop risk-based coverage, and maintain traceability from acceptance criteria to test results. Familiarity with AI-assisted coding or testing tools, plus the judgment to review generated code, test cases, and results. Foundational understanding of LLM capabilities and limitations, including hallucinations, variable outputs, and the need for structured evaluation. Strong analytical, troubleshooting, documentation, and communication skills; ability to work independently and collaboratively.Skills
Sign in to read and join the discussion.