Senior Automation Tester in Python

We are looking for a Senior Automation Tester in Python to own functional, security and performance test suites for the agentic gateway within our Enterprise Agent Development Platform — a production-grade, cloud-native ecosystem that enables engineering teams to define, orchestrate, deploy, and observe AI agents at scale.

Responsibilities

• Validate agentic workflows, including agent tool discovery, tool invocation and multi-step agent workflows
• Test MCP protocol functionality, including tool list aggregation, tool call routing and streaming response handling
• Verify agent authorization mechanisms through unauthorized tool access attempts and policy enforcement validation
• Conduct agent performance testing, covering tool discovery latency, concurrent agent sessions and agent-to-agent latency
• Build Python test automation suites using pytest with async support, mock MCP servers and agent workflow simulation
• Validate agentic observability, including trace completeness, agent step logging and audit trail verification

Requirements

• 3+ years of QA engineering experience for AI/ML or agent systems
• Hands-on experience testing AI agent systems in a production agentic AI project, such as MCP protocol testing, agent authorization/policy-enforcement testing or multi-step agent workflow test automation
• Experience testing LLM agent workflows, including tool calling and multi-step reasoning
• Expertise in security testing for authorization and authentication
• Skills in performance benchmarking for cloud services
• English proficiency at B2 level or higher

Nice to have

• Experience in MCP protocol testing
• Familiarity with agent framework testing (LangChain, LangGraph, Crew)
• Experience testing AWS Bedrock Agents
• Background in chaos engineering for agentic systems
• Skills in audit log validation (CloudTrail, OpenTelemetry traces)

Benefits

We gather like-minded people:

• Top tech minds driving innovation in AI, cloud and digital platform modernization
• Supportive team and agile, startup-like culture
• Hybrid by design mode and opportunity to work remotely within Poland
• Chance to work abroad for up to 60 days annually
• Business-driven relocation opportunities

We provide growth opportunities:

• Career development programs
• Thought leadership, mentoring, soft skills and well-being programs
• Certification (Anthropic, Gemini, GCP, Azure, AWS)
• English classes

We cover it all:

• Stable pay
• Participation in the Employee Stock Purchase Plan with a 15% discount
• Benefits package (health insurance, multisport, shopping vouchers)
• Referral bonuses up to $2,000
• Offices featuring entertainment and relaxation zones, table tennis and football, free snacks, coffee and more
• Corporate, social and well-being events

Please, note:

• Benefits listed above are available to employees only
• We are open for working with Contractors. Terms of B2B cooperation agreements are agreed individually
• We will reach out to selected candidates exclusively