QA Triage And Execution Analyst

Open 19d

Description

Owns the stability, accuracy, and signal quality of automated test execution by systematically analyzing, debugging, and resolving failing scripts across pipelines.

Key responsibilities:

  • Execute and monitor pipelines in Azure DevOps
  • Categorize failures: test defect vs environment vs data vs code
  • Track trends and provide triage reporting
  • Script-level debugging & root cause analysis
  • Debug automation scripts written in: Playwright / Selenium
  • Identify root causes such as:
    • Flaky selectors (dynamic DOM changes)
    • Synchronization / timing issues (wait conditions)
    • Assertion mismatches
    • Data dependency failures
  • Validate API failures using: Postman or GraphQL tools
  • Inspect logs and telemetry (App Insights, pipeline logs)

Requirements

  • Strong debugging and analytical skills
  • Experience with logs, APIs, and UI troubleshooting
  • Familiarity with test automation lifecycle
  • Experience with observability tools (App Insights, Azure monitoring)
  • Mortgage / FinTech experience