Software Engineer in Test, CI & Flaky-Test Tooling

Compensation: $120k – $160k • No equity

Flaky tests quietly erode trust in CI, and we build the internal tooling that helps teams get it back. We're hiring a software engineer in test to own the analysis core. It reads batches of test results, decides which tests are genuinely flaky, quarantines the worst offenders, and rolls everything up into a stable report. It's plain Ruby, standard library only. What you'll do: * Classify each test as passed, failed, or flaky, and get the retry logic right * Set sensible quarantine thresholds and handle the history window they look back over * Produce a report that comes out the same way every time * Maintain the small hand-rolled fixtures and custom assertions the harness ships with, without pulling in gems What we're looking for: * Solid Ruby and a feel for test tooling and harness design * Care with classification and aggregation logic, and deterministic output * Comfortable in minitest and staying inside the standard library Nice to have: Worked on CI or flaky-test analytics, and familiar with fixture and factory patterns