Junior Data Engineer: Scrapers, ETL & AI Enrichment - Equity
Cato is seeking a Python developer to own and operate scrapers for national tender portals, handling the full data lifecycle from extraction to enrichment. You will maintain the scraper, job behind it, and the data output, ensuring reliability even as sources change.
You’ll work with SQL, write robust ETL scripts, and leverage orchestrators like Prefect, Airflow, or Dagster. Strong curiosity about AI enrichment and data quality is essential.
Build and maintain scrapers for national tender portals and end-to-end ownership of sources. Keep scrapers alive as portals change HTML, endpoints, and pagination. Turn messy sources into clean records: broken HTML, inconsistent XML, APIs with schema issues. Write and maintain orchestrator flows: retries, backfills, alerting, and run verification. 1–2 years of Python in production (scrapers, ETL scripts, automation). Experience reading from databases daily; tuning and running queries is common. Exposure to orchestrators (Prefect, Airflow, Dagster) is a plus, not required.