Data QA Automation Engineer

Salary: ₱80,000 – ₱120,000 per month

Builds and maintains the automated testing framework, data quality gates and regression suites used by all EDW delivery teams. Enables the practice to raise automated regression coverage and enforce quality gates in the CI/CD pipeline.

Job Description

• Design, build and maintain the data test automation framework used across the practice, covering SQL Server, SSIS, dbt, Fivetran, Python ingestion and Databricks pipelines

• Implement the four data quality CI/CD gates (accuracy, latency, performance, security) as automated checks that block environment promotion when they fail

• Build reusable automated regression suites, source to target reconciliation, schema and row count checks, data profiling and anomaly detection

• Integrate automated tests into Azure DevOps pipelines and version control; own test execution reporting and dashboards

• Build synthetic and masked test data generation utilities and test data management practices

• Design the Delta Lake native validation approach for the Databricks Lakehouse (Bronze, Silver, Gold), including schema enforcement, time travel and Unity Catalog governance checks

• Pair with QA Leads and engineers to convert manual test cases to automated checks; coach the practice on automation standards and code review

• Measure and report automated regression coverage and automation ROI against practice targets

• Leverage AI/LLM-powered tools (e.g., Claude, Copilot) to accelerate test code, synthetic data and query generation, validating AI-assisted output before use in production test cycles

• Participate in agile ceremonies, code reviews and release activities as required

Required Key Knowledge Skills/ Experience

• 4+ years in test automation or data engineering, with hands-on data pipeline testing experience

• Strong Python and SQL; able to write production quality test code, not only scripts

• Hands-on experience with a data testing or quality framework (e.g., pytest, Great Expectations, dbt tests, Soda) and with building reusable test libraries

• Experience integrating automated tests with CI/CD (Azure DevOps Pipelines or equivalent) and Git-based workflows

• Working knowledge of ETL/ELT patterns and data warehouse concepts

• Ability to work independently, document designs clearly and mentor others on automation practice

• Good verbal and written communication skills

Preferred Experience

• Hands-on experience with Databricks (PySpark, Delta Lake, Unity Catalog, Databricks Workflows/Jobs, Asset Bundles) or other Big Data/Spark platforms

• Experience with performance and load testing of data pipelines EDW QA Practice Job Descriptions | Page 6

• Experience with data observability or anomaly detection tooling

• Databricks certification (e.g., Databricks Certified Data Engineer Associate) is a nice to have

• Banking or financial services industry experience

Education requirements

• Bachelors Degree in Computer Science, Information Systems, Computer Engineering or related field