Data Platform Engineer - Dagster & Python
Posted Updated
Description
Shop2Shop in Stellenbosch, South Africa, seeks a Data Engineer to design, build and maintain a modern data platform using Python and Dagster, delivering reliable data pipelines and governance. You will work with data analysts, DevOps and business stakeholders to translate data requirements into scalable solutions, focusing on data quality, lineage and observability.
The role offers a hybrid working model with regular in-office collaboration in Stellenbosch, and opportunities to experiment with
Design, build and maintain robust, declarative assets and graphs in Dagster. Write clean Python to extract, transform and load data into the warehouse. Implement data validation, testing and monitoring to ensure quality before reporting. Own day-to-day pipeline operations, including failures, reruns and backfills. Integrate Dagster with the broader data stack (dbt, DuckDB, Athena, PostgreSQL, Terraform). Automate deployments using Docker, Kubernetes and GitLab CI. 3–5 years of professional software or data engineering experience. Experience building, deploying and supporting production data pipelines with Dagster or similar tool. Strong Python programming and ETL/ELT design skills. Experience with data modeling and cloud data warehouses. Familiarity with data validation/testing (e.g., Pytest) and CI/CD pipelines. Awareness of data privacy (POPIA) and data governance.Skills
Sign in to read and join the discussion.