Staff SDET

The core responsibilities for the job include the following:

Quality Strategy and Architecture:

• Define and own the testing pyramid across unit, integration, component, E2E, contract, and accuracy regression layers.
• Set coverage and quality gates by repo/component risk tier and drive engineering alignment.
• Define testable-by-design patterns such as dependency injection, interface boundaries, and shift-left test requirements for CI/CD.

Quality and Accuracy Gates:

• Own CI/CD quality gates, including static analysis, coverage enforcement, component/E2E checks, and accuracy regression checks.
• Partner with DL/engineering teams to make model accuracy regression a first-class release gate.
• Define fast vs. full regression strategies and thresholds for PRs vs. main branch releases.
• Ensure quality gates are visible, stable, and trusted by engineering teams.

Metrics, SLOs, and Reliability:

• Build and own quality metrics: coverage, defect escape rate, accuracy per specialty, alert volume, code quality score, and reliability trends.
• Lead defect retrospectives and ensure every escaped defect results in a test, monitor, or process improvement.
• Partner on canary accuracy monitoring, incident-response quality bar, and SRE-AI feedback loops.

Leadership and Mentorship:

• Mentor SDETs through structured reviews, code reviews, and development planning.
• Influence engineers across squads without relying on reporting authority.
• Champion quality is built in, not tested in, across engineering.
• Partner with the AI Agents Engineer to evaluate and improve the Testing Agent.

Requirements:

• 7+ years of SDET/QA engineering experience, including at least 2 years at the Sta/Principal/Lead level or equivalent scope.
• Strong hands-on automation depth across at least two test frameworks, including pytest and/or Java-based frameworks such as JUnit/TestNG.
• Strong Java and Spring understanding; able to read application code, identify testability issues, and review test design meaningfully.
• Hands-on CI/CD quality pipeline ownership; has written CI YAML, configured required checks, and debugged pipeline/test infrastructure issues.
• Experience with static analysis and quality tools such as SonarQube, mypy, pylint, Checkstyle, SpotBugs, or equivalent.
• Experience with contract/component testing for distributed services.
• Experience with Docker and containerized test environments.
• Experience defining test strategy from scratch for inherited systems and driving remediation using data.
• Experience with ML/model regression or accuracy evaluation, or strong adjacent experience in data-heavy correctness testing.
• Strong SQL and BigQuery ability for defect analysis, trend rollups, accuracy/reliability correlation, and dashboard validation.
• Excellent leadership communication: can present quality health to engineering leadership with data and clear recommendations.