Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

Mastek

NewBe an early applicant

Senior ET Integration Testing (Xray, Python, AWS, SQL)

Posted

Description

Job Description: Senior QA Developer ETL Testing & Test Automation

Experience: 68 Years
Location: Offshore
Role Type: QA / Data Engineering Testing

Role Overview

We are seeking an experienced QA Developer with 6–8 years of experience in ETL testing, data validation, and test automation. The candidate will be responsible for designing, executing, and automating test cases for enterprise data ingestion and processing workflows.

The data integration platform uses SnapLogic to extract and integrate data from multiple source systems, land the data in AWS S3, and process it through multiple data layers: Landing, Raw, Prepared, and Curated. Workflow scheduling and orchestration are managed through Control-M.

The ideal candidate should have strong SQL skills, hands-on experience with ETL testing, and the ability to build reusable automated test scripts. Exposure to QA automation and test management tools such as Xray for Jira is highly desirable. The candidate should also be capable of helping establish structured test management practices and automated test execution processes that can support broader QA initiatives.

Key Responsibilities

1. ETL Testing & Data Validation

  • Analyze functional and technical requirements and prepare detailed ETL test scenarios and test cases.
  • Perform end-to-end testing of data ingestion pipelines built using SnapLogic.
  • Validate data movement from multiple source systems to AWS S3 and downstream data layers.
  • Verify data across Landing, Raw, Prepared, and Curated layers.
  • Perform source-to-target reconciliation and validate record counts, data types, null values, duplicates, and business rules.
  • Validate full loads, incremental loads, historical loads, and reprocessing scenarios.
  • Test data transformations, joins, aggregations, filtering, and business logic.
  • Investigate data discrepancies and collaborate with development teams to resolve defects.

2. Test Automation & Framework Development

  • Design, develop, and maintain automated test scripts for ETL and data validation.
  • Automate repetitive test cases for source-to-target reconciliation and data quality checks.
  • Develop reusable automation utilities and frameworks using Python and SQL.
  • Automate validation of record counts, schema structures, data completeness, uniqueness, referential integrity, and transformation results.
  • Execute automated regression test suites following code changes and pipeline enhancements.
  • Generate automated test execution reports and maintain test evidence.
  • Identify opportunities to improve test coverage and reduce manual testing effort.
  • Contribute to establishing reusable automated test cases and standardized QA automation practices.

3. Test Management & QA Automation Tools

  • Work with test management tools such as Xray for Jira to create, organize, maintain, and execute test cases.
  • Support the setup of test plans, test sets, test executions, and test traceability.
  • Maintain relationships between requirements, test cases, execution results, and defects.
  • Explore opportunities to integrate automated test scripts with Xray and Jira for test execution reporting and traceability.
  • Help establish repeatable processes for automated test case creation, execution, and reporting.
  • Collaborate with the broader QA team to support automation initiatives beyond ETL testing, where required.

4. AWS S3 & Data Layer Testing

  • Validate files delivered to AWS S3, including file naming conventions, formats, folder structures, and partitioning.
  • Verify data ingestion from S3 into the Landing and Raw layers.
  • Validate transformations and data movement from Raw to Prepared and Prepared to Curated layers.
  • Perform file-level and database-level validation.
  • Validate schema evolution, data type conversions, and handling of missing or malformed records.
  • Test error handling, rejected records, duplicate handling, and recovery scenarios.

5. SnapLogic & Control-M Workflow Testing

  • Understand SnapLogic pipelines and their source-to-target integration patterns.
  • Validate successful and failed execution of SnapLogic pipelines.
  • Test Control-M job schedules, dependencies, job sequencing, and workflow completion.
  • Validate upstream and downstream job dependencies and ensure data availability before subsequent processing.
  • Test failure scenarios, restart/recovery, rerun, and backfill scenarios.
  • Reconcile Control-M execution status with actual data availability and processing results.

6. Defect Management & QA Documentation

  • Log, track, and manage defects using Jira or similar tools.
  • Collaborate with developers, data engineers, and business teams to troubleshoot data issues.
  • Prepare test plans, test scenarios, test cases, traceability matrices, and test execution reports.
  • Participate in SIT, regression testing, UAT support, and production validation.
  • Provide QA status updates, defect summaries, and test completion reports.

Required Skills & Experience

  • 6–8 years of experience in software QA, with at least 4–5 years focused on ETL testing and data validation.
  • Strong hands-on experience in ETL testing for enterprise data integration platforms.
  • Strong SQL skills, including complex queries, joins, subqueries, aggregations, and analytical functions.
  • Hands-on experience developing and executing automated test scripts using Python.
  • Experience validating data pipelines involving multiple source systems and target data platforms.
  • Experience with AWS S3, including file-level validation and data ingestion testing.
  • Strong understanding of data warehousing concepts and layered data architecture.
  • Experience testing data across Landing, Raw, Prepared, and Curated layers.
  • Experience with full load, incremental load, and historical data processing validation.
  • Experience in test case design, test execution, defect management, and regression testing.
  • Strong analytical, troubleshooting, and communication skills.

Good-to-Have Skills

  • Exposure to Xray for Jira or similar test management tools.
  • Experience setting up and managing test plans, test cases, test executions, and test reporting in Xray.
  • Exposure to integrating automated test scripts and execution results with Xray/Jira.
  • Familiarity with broader QA automation frameworks and practices.
  • Experience with Python-based automation frameworks such as Pytest.
  • Hands-on experience with SnapLogic pipeline testing.
  • Experience with Control-M job scheduling and workflow orchestration.
  • Experience with Snowflake, including SQL-based data validation.
  • Familiarity with dbt and transformation testing.
  • Knowledge of data quality frameworks and tools.
  • Experience with CI/CD-based automated test execution.

Qualifications

  • Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field.
  • Ability to work independently in a distributed offshore/onshore delivery model.
  • Strong collaboration skills and ability to work with developers, data engineers, and QA teams.
  • Ability to understand complex data flows and translate business requirements into effective test scenarios.

Key Expectations

The selected candidate is expected to be hands-on and capable of independently:

  1. Understanding end-to-end ETL workflows and data movement.
  2. Designing comprehensive test cases for each data processing layer.
  3. Developing Python and SQL-based automated test scripts.
  4. Executing automated and manual ETL test scenarios.
  5. Validating data accuracy and completeness across source, S3, and target layers.
  6. Testing Control-M workflow execution, dependencies, and recovery scenarios.
  7. Using or supporting test management platforms such as Xray to organize and track test cases.
  8. Contributing to the setup and improvement of automated testing practices that can be reused across ETL and other QA initiatives

Skills

Apply

See also