Test Engineer – Data Migration & Transformation Validation - Java / Python automation along with CI/CD integration

Project description

We are looking for an experienced Database Testing Lead with strong expertise in SQL-based backend validation. The candidate will be responsible for validating large data sets, performing file-to-file reconciliation, volume testing, and ensuring accurate data validation from AWS sources to downstream systems (including PNR creation on PID data). API testing experience is required as a secondary skill.

Responsibilities

• Data Migration & Transformation Validation
• Lead testing efforts for large-scale data transformation and migration initiatives involving millions of records across enterprise Network Operation platforms.
• Design and execute comprehensive data validation strategies to ensure data accuracy, completeness, consistency, and integrity during migrations.
• Develop complex SQL queries and automated validation scripts to reconcile source and target systems at scale.
• Validate ETL/ELT processes, transformation rules, data mappings, and business logic across multiple data domains.
• Perform end-to-end testing of batch, real-time, and incremental data migration workflows.
• Identify, analyze, and troubleshoot data quality issues, migration defects, duplicates, missing records, and transformation anomalies.
• Collaborate closely with data engineers, architects, business analysts, and application teams to define test strategies and acceptance criteria.
• Generate detailed data quality metrics, reconciliation reports, and migration readiness assessments for stakeholders.
• Drive best practices in database testing, automation, and data quality engineering to ensure successful delivery of enterprise migration programs. AI Agent Onboarding & Test Automation
• Partner with AI agent onboarding partners to define and execute the onboarding approach for all three UA agents.
• Establish an automation-first testing strategy for the product and agent-based workflows.
• Review the product architecture diagrams, and overall solution objectives to understand the end-to-end agent workflow and testing requirements.
• Identify opportunities to use AI-driven test automation to improve test coverage, execution efficiency, and agent workflow validation.
• Collaborate with development, architecture, AI partners, and QA teams to embed DB automation & AI agent into the product development lifecycle.
• Define test scenarios and validation strategies for AI-agent-based workflows, covering functional, integration, data, and end-to-end validation.

SKILLS

Must have

• Primary Skills
• Strong experience in Database Testing using SQL
• Expertise in writing complex SQL queries (joins, aggregations, subqueries) and PLSQL
• Able to build Automation either Using Java / Python along with CI/CD integration
• Experience in API Testing
• Experience in File-to-File Data Validation
• Hands-on experience with Volume Testing / Large Data Set Validation
• Experience in data reconciliation and backend testing
• Ability to validate data pipelines and data transformations
• Experience validating data flow between systems and databases
• Strong understanding of data integrity, accuracy, and consistency checks Technical Skills
• SQL (Mandatory)
• Database platforms such as Oracle, SQL Server, PostgreSQL, or MySQL
• AWS data validation
• Experience working with large data volumes
• Knowledge of data migration and ETL validation

Nice to have

Secondary Skills • API Testing using tools such as Postman, Swagger, or similar tools • Experience in AI-driven test automation • Understanding of REST APIs and HTTP methods (GET, POST, PUT, DELETE) • Ability to validate API responses with database data • Knowledge of JSON/XML validation