Test Automation Engineer
Summary
Designs and runs automated tests for data pipelines and ETL workflows, using Java, SQL, Spark, and CI/CD tools to validate data quality and transformations.
· Must have a minimum of 4-6 years’ relevant experience in software testing.
· Good understanding & working knowledge of Agile/Scrum
· Strong experience in ETL testing, data validation, data reconciliation, and source-to-target testing.
· Strong hands-on experience with MS SQL Server and advanced T-SQL.
· Experience testing Java/Spark-based data processing applications.
· Hands-on automation experience using Java, JUnit/TestNG, Maven/Gradle, and data-driven test frameworks.
· Ability to validate large datasets using SQL, Spark SQL, and automated comparison utilities.
· Experience with batch processing, incremental loads, data quality checks, and regression testing.
· Familiarity with CI/CD tools such as Jenkins, GitLab CI, Azure DevOps, or GitHub Actions.
· Experience with Git, scripting using PowerShell/Bash/Python, and automated test reporting.
· Ability to analyze ETL logs, Spark job logs, and SQL Server performance issues.
· Knowledge of file formats such as CSV, JSON, XML, Parquet, Avro, and fixed-width files.
· Good understanding of test data management, data masking, and production-like test data setup.