Senior Data QA Engineer - Python Automations & Databricks
Summary
The Senior Data QA Engineer will develop automated testing frameworks for data pipelines using Python, PySpark, and Databricks tools. The role focuses on ensuring data integrity, validating transformations, and verifying governance controls within a lakehouse environment.
APAR TECHNOLOGIES PTE. LTD. in Singapore seeks a senior QA/Data Quality Engineer to validate data using Python-based testing, Great Expectations and Pandera.
You will build automated tests for PySpark transformations, validate Delta Live Tables expectations, and ensure data integrity across the lakehouse. You will collaborate on end-to-end data reconciliation, scale testing to meet performance SLAs, and verify governance controls such as Unity Catalog RLS and data lineage.