Senior Systems Testing / QA Specialist
Summary
Senior QA contractor (via Upstaff) for the Ontario Public Service, testing public-health systems such as Panorama, REACT, and IMMS onsite in Toronto. Day to day: lead functional/non-functional, API (HL7/FHIR, REST), BI/reporting, accessibility, and security testing; produce full test documentation; and manage defects using Selenium, Postman, SQL, and Jira/Confluence/TestRail.
- Perform functional and non-functional system testing of interfaces to:
- Panorama
- REACT
- Panorama IMMS & Inventory Core
- Extension applications
- Enhancements and defect resolutions
- Test Business Objects (BO) reporting based on defects identified by business users and critical Panorama changes.
- Create complete system testing documentation and artifacts, including:
- Test strategies
- Test plans
- Test cases/use cases
- Test scripts
- Automated test scripts
- Test data
- Test results reports
- Defect logs and summary reports
- Transform functional, business, and system knowledge into effective test case planning and execution.
- Create test data according to approved test plans.
- Analyze test results, perform retesting, and continue testing until expected results are achieved.
- Participate in user walkthroughs and reviews and ensure client acceptance criteria are met.
- Recommend changes where testing results do not meet required standards.
- Retest implementation criteria in live/production environments and recommend user sign-off.
- Work closely with developers, architects, product owners, business users, and other stakeholders to establish effective test plans based on feature and technical documentation.
- Apply QA and technical expertise to identify, track, troubleshoot, and resolve testing and production issues.
- Support quality assurance, defect management, and maintenance of client service integrity.
Requirements
- 5+ years of experience working with federal, provincial, or broader public-sector healthcare providers.
- Experience with public-sector health-related projects.
- Experience working on large, complex IT health-related projects.
- Knowledge of Public Sector Enterprise Architecture artifacts, processes, and practices, with the ability to produce technical documentation compliant with industry standards.
- In-depth knowledge of industry standards such as Project Management Institute (PMI) practices and Public Sector I&IT project management methodologies.
- Knowledge and understanding of Ministry policies and IT project approval processes and requirements.
- Experience adopting and adhering to:
- Public Sector Unified I&IT Project Methodology
- Public Sector Enterprise Architecture
- Public Sector Gating Process
- OPS Standard Systems Development Methodologies
- Acting as a Lead Systems Testing/QA Specialist across multiple work streams.
- Providing guidance and oversight to junior testers.
- Planning, organizing, coordinating, and implementing testing efforts.
- Preparing test plans and coordinating test execution.
- Knowledge of testing methods in an object-oriented environment.
- Experience across all stages of system testing, including:
- Testing strategy
- Testing tool selection
- Test planning
- Test case preparation
- Test data preparation
- Manual test execution
- Automated test execution
- Defect logging and tracking
- Clinical systems
- Mission-critical systems
- High-volume transactional systems
- Highly available environments
- Commercial Off-the-Shelf (COTS) solutions
- Patches and new releases
- Enhancement requests
- Acceptance testing
- Regression testing
- In-house web applications
- HL7/FHIR-based web services
- RESTful services
- JSON/XML
- APIs
- Reporting solutions
- Integration components
- Extensions and enhancements
- SAML
- JWT
- Test strategies
- Test plans
- Test use cases
- Test cases
- Test scripts
- Test data
- Test execution/results documentation
- Experience developing and executing automated test scripts.
- Experience with automation frameworks/tools such as Selenium.
- Experience using API testing tools to query and test interfaces at the messaging layer.
- Experience testing web services using tools such as:
- Rational ClearQuest
- SOAP-UI
- Postman
- Programming languages
- Experience with information retrieval packages.
- Experience performing data queries and ad-hoc queries using SQL.
- Knowledge of other query languages.
- Ability to validate data accuracy, completeness, and integrity.
- Experience performing accessibility testing of:
- Websites
- Web content
- Mobile applications
- Knowledge of W3C Web Content Accessibility Guidelines (WCAG) 2.0.
- Experience using tools supporting web accessibility testing in accordance with AODA legislation.
- Performance testing results
- Security testing results
- Defect review materials
- Client/project team testing reports
- BI data setup and integration
- Data validation
- Predefined analytical reports
- Ad-hoc reporting tools
- Dashboards
- Accuracy, completeness, and data integrity validation
- Experience validating successful deployment of releases into production environments.
- Preparing reports documenting testing and release results.
- Experience performing business scenario and cross-system integration testing on product modules.
- Experience with healthcare-related systems such as:
- Ontario Health Client Registry
- Provider Registry
- Audit Services
- Experience reviewing and providing testing input into:
- Technical requirements
- Business requirements
- Business Intelligence requirements
- Ability to identify testing considerations and potential issues early in the SDLC.
- Experience working in both traditional and Agile teams.
- Knowledge of standard DevOps processes and tools.
- Knowledge and experience with at least one programming language.
- Strong understanding of all phases of the Systems Development Life Cycle (SDLC).
- Experience reviewing business and technical documentation from a testing perspective.
- Knowledge and understanding of Information Management principles, concepts, policies, and practices.
- Identifying and documenting issues and risks.
- Creating and maintaining:
- Defect logs
- Defect summary reports
- Experience using tools such as:
- Jira
- Confluence
- TestRail
- Updating project tasks and status.
- Participating in QA and cross-functional team meetings.
- Prioritizing test execution based on:
- Business priorities
- Defect patterns
- Available testing time
- Working creatively around shared-resource challenges involving:
- Test environments
- Test data
- Participating actively in:
- Walkthroughs
- Defect triage
- QA reviews
- Proven technical leadership skills and the ability to identify improvement opportunities and recommend solutions.
- Exceptional analytical, problem-solving, and decision-making skills.
- Strong interpersonal, verbal, written communication, and presentation skills.
- Proven troubleshooting and critical-thinking capabilities.
- Strong listening skills to facilitate effective issue resolution.
- Effective consulting skills and the ability to build strong relationships with stakeholders.
- Excellent customer service skills, including tact and diplomacy.
- Ability to work as a:
- Motivated
- Flexible
- Detail-oriented
- Creative
- Organized
- Collaborative team player
- Strong perseverance and ability to multitask and meet strict deadlines.
- 5+ years public-sector healthcare experience
- 7+ years senior QA/systems testing experience
- Lead QA/Test Specialist experience
- Junior tester guidance/oversight
- Test strategy and test planning
- Manual and automated testing
- Clinical systems testing
- Mission-critical/high-volume systems testing
- COTS testing
- Web application testing
- HL7/FHIR
- REST/JSON/XML
- API testing