QA Automation Engineer
Summary
Develops and maintains automated data validation frameworks using Python, PySpark, and Databricks to ensure data integrity across systems, focusing on record-level and schema validation.
Job Description: Strong Python and PySpark/Spark SQL data testing experience, especially for data validation and comparison Hands-on Databricks experience, including notebooks, Delta Lake, Unity Catalog, and job scheduling Strong SQL skills for source-to-target data validation Experience building automated data testing frameworks , not just manual QA Experience with data validation such as record-level comparison, schema validation, count validation, data reconciliation, and column-level mismat…