Data Engineer Pipelines and Lakehouses
Posted
Description
Build scalable data pipelines and lakehouse systems at Spade Technologies, Inc., with Manitoba preferred and all locations considered. Work full time.
As a Data Engineer reporting to the CTO, you will own ingestion pipelines, data models, and infrastructure. You will support herd, feed, financial, and operational datasets for farmer-facing and enterprise products. Your work will focus on reliable, secure, performant data systems.
Key Responsibilities:
Design scalable batch and streaming ingestion pipelines Implement ETL/ELT workflows and validation layers Develop unified models for herd and financial datasets Manage modern data lake complexity, including Iceberg and Databricks Prepare data for ML and AI systems Requirements:
Four or more years of production data engineering experience Expertise with Databricks, Airflow, dbt, Spark, or similar Experience managing warehouses or lakehouses Hands-on AWS, GCP, or Azure infrastructure experience Knowledge of structured and semi-structured data formats Apply data modeling, cloud infrastructure, and pipeline expertise to strengthen Spade’s food data platform.
Design scalable batch and streaming ingestion pipelines Implement ETL/ELT workflows and validation layers Develop unified models for herd and financial datasets Manage modern data lake complexity, including Iceberg and Databricks Prepare data for ML and AI systems Requirements:
Four or more years of production data engineering experience Expertise with Databricks, Airflow, dbt, Spark, or similar Experience managing warehouses or lakehouses Hands-on AWS, GCP, or Azure infrastructure experience Knowledge of structured and semi-structured data formats Apply data modeling, cloud infrastructure, and pipeline expertise to strengthen Spade’s food data platform.
Skills
Sign in to read and join the discussion.