Data Automation Engineer / Functional Tester
Summary
The Data Automation Engineer performs ETL testing, data validation, and reconciliation using Java, Spark, and MS SQL Server. The role involves automating test frameworks, managing test data, and analyzing system logs to ensure data quality in batch processing environments.
Data Automation Engineer:
- Strong experience in ETL testing, data validation, data reconciliation, and source-to-target testing.
- Strong hands-on experience with MS SQL Server and advanced T-SQL.
- Experience testing Java/Spark-based data processing applications.
- Hands-on automation experience using Java, JUnit/TestNG, Maven/Gradle, and data-driven test frameworks.
- Ability to validate large datasets using SQL, Spark SQL, and automated comparison utilities.
- Experience with batch processing, incremental loads, data quality checks, and regression testing.
- Familiarity with CI/CD tools such as Jenkins, GitLab CI, Azure DevOps, or GitHub Actions.
- Experience with Git, scripting using PowerShell/Bash/Python, and automated test reporting.
- Ability to analyze ETL logs, Spark job logs, and SQL Server performance issues.
- Knowledge of file formats such as CSV, JSON, XML, Parquet, Avro, and fixed-width files.
- Good understanding of test data management, data masking, and production-like test data setup.
EALicense No: 11C4879 / Registration ID : R1218583
AparTechnologies Pte Ltd, Singapore