AI-Powered Data Pipeline Architect (Databricks + AWS)
Summary
Senior data engineering role in Toronto designing and building enterprise-scale data pipelines on Databricks, PySpark, Delta Lake, and AWS. The engineer uses AI tooling (GitHub Copilot, Claude Code CLI) daily and builds AI-ready platforms with schema inference, data-quality rules, RAG, and vector stores.
United Software Group Inc. is seeking a senior Data Engineer to design and build enterprise-scale data pipelines using Databricks, PySpark, and Delta Lake within an AWS data ecosystem. The role emphasizes AI-assisted development, schema inference, data-quality rules, and AI-ready platforms supporting RAG and vector stores.
The candidate will lead complex data engineering initiatives, leverage GitHub Copilot and Claude Code CLI daily, and accelerate pipeline development with AI-powered tooling.