Senior QA Analyst
Summary
Senior QA Analyst at Filevine, a legal-AI company, driving quality across AI-powered workflows: designing end-to-end test strategies, validating non-deterministic AI outputs, testing APIs, webhooks, and event-driven systems, and mentoring QA staff. Hybrid role (2-3 days/week or onsite) from the San Francisco, Chicago, Salt Lake City, or New York office.
About the Role
Seeking a highly experienced QA professional who can operate comfortably across traditional QA, AI systems, and integration between the two worlds. This role is responsible for driving quality initiatives across AI driven workflows, mentoring QA team members, and partnering closely with Product and Engineering to ensure reliable, compliant, and scalable software releases.
Responsibilities:
-
Design and execute comprehensive test strategies covering end-to-end workflows, integrations, and event driven systems
-
Ensure accuracy and reliability of AI generated conversations, call summaries, and data capture across varied scenarios
-
Contribute to and maintain QA documentation, standards, and the organizational knowledge base
-
Partner with Product and Engineering to influence requirements, design decisions, and release readiness
-
Drive continuous improvement by identifying gaps in processes, tooling, and test coverage
-
Dig into technical problems and write clear, detailed, and repeatable defect reports
-
Conduct exploratory testing to evaluate robustness and functionality of products.
-
Work with QA engineers to increase automation coverage of features based on business priorities and risks
-
Demonstrate attention to detail and organization in all aspects of work
Qualifications and Skills:
-
Bachelor’s degree in Computer Science or a related field, or equivalent practical experience
-
7+ years of experience in software quality assurance, including ownership of complex feature areas
-
Experience developing and executing test strategies for end to end workflows
-
Exposure to AI driven systems, conversational interfaces, or data driven automation preferred
-
Ability to quickly learn new products, technologies, and business domains
-
Experience validating AI or ML assisted features, including non deterministic outputs and regression risks
-
Advanced expertise in manual testing methodologies and test case design for complex systems
-
Strong experience testing APIs, webhooks, and third party integrations
-
Experience testing event driven architectures and downstream data delivery
-
Familiarity with compliance driven workflows, auditability, and data traceability
-
Strong analytical and problem solving skills with attention to detail
-
Excellent written and verbal communication skills, including clear defect documentation
-
Ability to influence development teams and advocate effectively for quality initiatives
What they ask for
Required
- Bachelor's degree in Computer Science or related field, or equivalent practical experience
- 7+ years of experience in software quality assurance, including ownership of complex feature areas
- Experience developing and executing test strategies for end-to-end workflows
- Ability to quickly learn new products, technologies, and business domains
- Experience validating AI or ML assisted features, including non-deterministic outputs and regression risks
- Advanced expertise in manual testing methodologies and test case design for complex systems
- Strong experience testing APIs, webhooks, and third-party integrations
- Experience testing event-driven architectures and downstream data delivery
- Strong analytical and problem-solving skills with attention to detail
- Excellent written and verbal communication skills, including clear defect documentation
- Ability to influence development teams and advocate effectively for quality initiatives
- Reside in or near San Francisco, Chicago, Salt Lake City, or New York metro areas; hybrid (2-3 days in-office/week) or fully onsite
Preferred
- Exposure to AI driven systems, conversational interfaces, or data driven automation
- Familiarity with compliance-driven workflows, auditability, and data traceability
Skills
As published by lever · 12 questions · 6 written answers
Basics
Resume/CV, Full name, Email, Phone, Current location, Current company, LinkedIn URL, GitHub URL, Portfolio URL, Other website, What is your age range?, I identify my ethnicity as, Gender, Veteran Status
Pick from a list (6)
- Are you legally authorized to work in the United States?
- Will you now or in the future require sponsorship for employment (H1B, Visa, OPT, etc)?
- Do you have at least 7 years of Software QA Experience optional
- Have you previously held a role where you provided leadership or mentorship to other QA professionals?
- Do you have experience designing and executing test strategies for large-scale or complex software projects?
- Have you led or participated in risk analysis and test strategy planning for large projects?
Written answers (6)
- What are your base salary expectations for your next role? Please note that we utilize geographic pay structures based on local market rates, and our final offers factor in total compensation including equity, bonus structures, and benefits.
- If yes, please elaborate: optional
- If yes, please elaborate: optional
- How have you created or influenced QA processes, standards, or best practices at a previous organization?
- If yes, please elaborate: optional
- Can you provide examples of tools or technologies you have introduced or championed to improve QA effectiveness? optional