Associate Test Engineer
Summary
Associate Test Engineer on the Enterprise Data Solution team: builds and maintains test automation frameworks, CI/CD pipelines and AI/LLM-assisted test generation, testing Databricks workloads, SQL Server databases and SSIS packages with Python and SQL, plus performance/load and API testing.
Our Enterprise Data Solution team is looking for a modern Test Engineer. The Test Engineer will have expertise in automated testing, CI/CD pipelines and AI-driven test generation to ensure the quality and reliability of our software products through rigorous testing and continuous improvement of testing processes.
Key Responsibilities
- Develop and maintain comprehensive test strategies and plans.
- Design, develop and maintain robust test automation frameworks (e.g., Selenium).
- Perform exploratory testing to identify potential issues and areas for improvement.
- Collaborate with cross-functional teams to understand product requirements and design effective test solutions.
- Conduct performance and load testing to ensure system scalability and reliability.
- Implement and manage continuous integration and continuous testing pipelines.
- Develop and maintain automated tests for data platforms and pipelines, including Databricks workloads, SQL Server databases and SSIS packages, using Python and SQL.
- Test end-to-end data solutions by validating data quality, transformation logic, reconciliation, orchestration, security and performance across data pipelines and platform components.
- Use AI/ML and Large Language Model (LLM) tools to support the preparation of test plans, generation and maintenance of test cases and test data, log analysis, anomaly detection, test execution and analysis of test results, with appropriate human review and validation.
- Create detailed test reports and metrics to communicate testing progress and results.
- Participate in code reviews to provide feedback on testability and quality.
- Stay updated with the latest industry trends and best practices in software testing.
- Strong background in software testing methodologies and practices.
- Experience with performance and load testing tools (e.g., JMeter, LoadRunner).
- Experience with API testing (e.g., Postman).
- Proficiency in scripting languages (e.g., Python, Java, JavaScript) for test automation.
- Strong Python scripting capability for test automation, data validation and the development of reusable testing utilities.
- Hands-on experience testing solutions on the Databricks platform, including notebooks, jobs and workflows, Delta tables, data pipelines and data quality controls.
- Advanced SQL testing skills using SQL Server Management Studio (SSMS), including complex queries, stored procedures, data reconciliation and validation of ETL/ELT outcomes.
- Strong experience testing SQL Server Integration Services (SSIS) packages and SQL Server-based data integrations, including error handling, dependencies, transformations and data quality outcomes.
- Familiarity with CI/CD tools and processes (e.g., Azure DevOps, GitLab CI).
- Demonstrated ability to use AI/ML and Large Language Model (LLM) tools responsibly to prepare test plans, develop and refine test cases, generate test data, support testing activities and analyse test evidence and results.
- Experience using Large Language Models (LLMs) to analyse logs, identify anomalies and generate synthetic test data, while validating AI-generated outputs for accuracy, completeness, traceability and alignment with requirements.
- Experience working with an Agile delivery team across BAU and projects