Data Engineer - Validation & quality
Posted Updated
Description
Data Engineer – Validation & Quality
Responsibilities
- Build rule-based and statistical validation frameworks using Pandas / NumPy.
- Implement contradiction detection, reconciliation, and anomaly flagging.
- Design and compute confidence metrics for each evidence record.
- Automate schema compliance, sampling, and checksum verification across data sources.
- Collaborate with the Kernel to embed validation results into every output artifact.
Requirements
- 5 + years in data engineering, data quality, or MLOps validation.
- Strong SQL optimization and ETL background.
- Familiarity with data lineage, DQ frameworks, and regulatory standards (SOC 2 / GDPR).
Skills
Sign in to read and join the discussion.