Data Engineer II — Production Pipelines & Features
Posted Updated
Description
Afiniti is seeking a Data Engineer II to own production pipelines, ensuring freshness and reliability while collaborating with data scientists and client data teams. You will build, validate, and monitor features for model training, and craft validation checks to prevent schema drift and data quality issues.
You will work within the Applied AI team to understand data flows from client systems such as switches and IVR, improving onboarding and data quality while delivering robust data products
Own and maintain production data pipelines across client and third-party sources to agreed freshness and reliability commitments. Build and validate features for model training to the data scientists' requirements; verify accuracy against source and monitor over time. Develop validation and reconciliation checks that catch schema drift, gaps, and integrity failures before they reach a model. Understand the Afiniti product as a system, including its infrastructure and deployment and how data flows from client systems such as the switch and IVR into our pipelines. 2–4 years building production data pipelines or analytics datasets. Advanced SQL with window functions and production data processes. Proficient in Python for data processing with version control, reviews, and testing.Skills
Sign in to read and join the discussion.