Retail Data Pipeline Engineer
Posted
Description
Shape large retail datasets with SQL, Python, and dimensional modelling as a full-time Data Engineer at Pattison Food Group in Langley, BC.
Working with the Team Lead, Data & Analytics, you will design high-performance pipelines and reusable curated datasets. You will develop fact and dimension tables, slowly changing dimensions, and incremental processing for modern analytics. Collaboration, documentation, and production support are central to the work.
Key Responsibilities:
- Design scalable pipelines with Databricks, Spark, Python, PySpark, and SQL
- Develop fact tables, dimension tables, and curated analytical datasets
- Write Spark or Databricks scripts supporting machine learning pipelines
- Optimize solutions for performance, reliability, scalability, and cost
- Translate partner requirements into practical data solutions
Requirements:
- Bachelor’s degree in STEM; Master’s degree preferred
- Minimum two years supporting production pipelines in cloud environments
- Strong SQL and Python or PySpark experience with large datasets
- Experience with modern data platforms including Databricks or Delta Lake
- Clear communication and documentation with technical and non-technical partners
Use dimensional modelling, SQL, Python, and pipeline optimization to strengthen Pattison Food Group’s retail data capabilities.
Skills
Sign in to read and join the discussion.