Senior Test Automation Engineer
Posted Updated
Description
- Our principle: Engineering owns quality; Quality owns the quality system. As a Senior Test Automation Engineer, you’ll own test automation strategy for a product domain. You’ll design automation that engineers build on, make release risk explicit, and help us move from catching defects to preventing them
- Own test automation strategy for your domain. Decide what to test, at which level, and why, across complex features and the teams that build them. Balance short-term delivery with the long-term health of our test suites
- Design automation others build on. Build scalable, maintainable frameworks, fixtures, and utilities that engineers use to write their own tests. Partner with engineers to improve testability, and use AI-assisted test generation where it raises quality and speed
- Make release risk explicit. Run pre-release risk assessments, build the test matrix across integrations, environments, and customer workflows, and lead test planning for high-risk releases and hotfixes. Help define the go/no-go signals your domain ships on
- Test the way radiologists work. Turn radiologist personas and real workflows into test cases. Bring customer-matched environments into validation, such as Windows and Electron workstations, dictation systems, and PACS/RIS integrations, and use exploratory testing where automation falls short
- Keep the test signal trustworthy. Drive down flaky and low-signal tests, triage failures quickly, cut suite execution time, and improve test data and environment stability with our platform teams
- Lead non-functional quality in your domain. Lead or co-lead performance and load testing, security checks in pipelines, and accessibility and compliance coverage such as HIPAA-related auditability
- Test AI systems responsibly. Design evaluations for non-deterministic outputs, such as speech recognition and generated impressions, that don’t hinge on a single result
- Turn escaped defects into prevention. Use incident reviews and customer-reported defects to add regression coverage and update risk profiles, so the same failure doesn’t reach a radiologist twice
- Use data to guide decisions. Track escaped defects, test stability, and time to detect for your domain, and keep suites organized in our test case management system so results are visible and comparable
- Raise the bar around you. Mentor TAEs and software engineers across teams, act as a trusted quality partner to Engineering Managers on risk and release readiness, and contribute to hiring, onboarding, and our Quality community
Benefits
- 100% health, dental, & vision
- Flexible PTO
- WFH stipend
- 401k plan
- Stock options
- Socials & off-sites
- API testing experience across REST and GraphQL services (for example ASP.NET Core Minimal API, FastAPI, Postman), including how tests interact with data and downstream dependencies
- Strong programming skills in TypeScript and/or Python; experience with an object-oriented language such as C# or Java is a plus
- Experience with risk-based test strategy for integration-heavy systems that run across many customer configurations
- A track record of reducing flakiness and suite runtime, backed by data
- A shift-left mindset: you’ve helped developers own their tests rather than owning every test yourself
- Deep experience with end-to-end frameworks such as Playwright, Selenium, or Cypress
- Detail-oriented, collaborative, and able to influence without authority, with clear communication and experience mentoring engineers
- This role requires working from our San Francisco office
- Strong debugging skills across services, data, and environments, with working knowledge of SQL, logs, and observability tools
- Experience building tests into CI/CD pipelines such as GitHub Actions or CircleCI, including PR-level gating, parallelization, and reporting
- 6+ years of software engineering or test automation experience, including 3+ years designing and owning automation frameworks
- Hands-on use of AI tools to write, maintain, and triage tests, with the judgment to review what they produce
- You’ve worked in healthcare or another regulated environment (HIPAA, PHI, SOC 2), ideally at a startup
- You’re familiar with radiology systems: PACS, RIS, dictation platforms such as PowerScribe or Fluency, HL7/FHIR, FHIRcast, or DICOM
- You’ve automated Windows desktop or Electron applications, for example with WinAppDriver or UI Automation
- You’ve tested ML, AI, or speech systems where outputs aren’t deterministic
- You’ve owned performance or load testing, or integrated security checks into pipelines
- You’ve worked with AWS or Google Cloud, and provisioned test environments with tools like Docker or Terraform
- You’ve used a test case management system such as Testmo, or built quality dashboards in tools like Grafana
Skills
Sign in to read and join the discussion.