Data Engineer Pipelines and Lakehouses
Summary
Data engineer owning ingestion pipelines, data models, and lakehouse infrastructure (Databricks, Iceberg, Airflow, dbt, Spark) on cloud infrastructure for Spade Technologies' food data platform, supporting herd, feed, financial, and operational datasets for farmer-facing and enterprise products.
Build scalable data pipelines and lakehouse systems at Spade Technologies, Inc., with Manitoba preferred and all locations considered. Work full time.
As a Data Engineer reporting to the CTO, you will own ingestion pipelines, data models, and infrastructure. You will support herd, feed, financial, and operational datasets for farmer-facing and enterprise products. Your work will focus on reliable, secure, performant data systems.
Key Responsibilities:
- Design scalable batch and streaming ingestion pipelines
- Implement ETL/ELT workflows and validation layers
- Develop unified models for herd and financial datasets
- Manage modern data lake complexity, including Iceberg and Databricks
- Prepare data for ML and AI systems
Requirements:
- Four or more years of production data engineering experience
- Expertise with Databricks, Airflow, dbt, Spark, or similar
- Experience managing warehouses or lakehouses
- Hands-on AWS, GCP, or Azure infrastructure experience
- Knowledge of structured and semi-structured data formats
Apply data modeling, cloud infrastructure, and pipeline expertise to strengthen Spade’s food data platform.
Skills
Sign in to read and join the discussion.