Data Quality Engineer (Databricks & dbt)
Posted Updated
Description
Cognizant Technology Solutions Corporation is seeking a Data Quality Engineer (Databricks & dbt) to ensure the accuracy and reliability of enterprise data platforms. The role focuses on automating tests, validating pipelines in Databricks, and integrating quality gates into Azure DevOps within a US-based remote framework.
The ideal candidate will design data quality tests, develop Python validation scripts, monitor quality metrics, and collaborate with data engineers and business stakeholders to
Design, build, and maintain automated data quality tests in dbt. Develop Python-based validation frameworks and scripts for data reconciliation. Validate data pipelines and transformations in Databricks (PySpark/SQL, Delta Lake). Integrate data quality gates into Azure Pipelines so builds are blocked when tests fail. Define, monitor, and report on data quality metrics and set up alerting for anomalies. Triage and root-cause data defects with cross-functional teams and track to resolution. Write and maintain test plans, test cases, and data quality documentation. Contribute to data governance and quality standards, including data contracts and lineage awareness. 5+ years in QA, data testing, or data engineering roles with a focus on data validation. Hands-on experience with dbt (Core or Cloud): tests, macros, models, documentation. Strong Python skills (pandas, PySpark, pytest) for test automation. Practical experience with Databricks: notebooks, jobs, Delta tables, Unity Catalog. Experience building and maintaining Azure Pipelines (Azure DevOps) for CI/CD. Solid understanding of data quality concepts, dimensions, and frameworks. Experience with Git and version-controlled development workflows. Experience in using GitHub copilot Medical/Dental/Vision/Life Insurance Paid holidays plus Paid Time Off 401(k) plan and contributions Long-term/Short-term Disability Paid Parental Leave Employee Stock Purchase PlanSkills
Sign in to read and join the discussion.