Senior Data Engineer to design and optimize data pipelines including implementing Data Lakehouse architectures and optimizing ETL workflows
S I Systems Senior Data Engineer to design and optimize data pipelines including implementing Data Lakehouse architectures and optimizing ETL workflows
Summary
Senior Data Engineer hired through S I Systems for its power & utilities client to design scalable cloud data pipelines, implement Data Lakehouse architectures, and optimize ETL workflows for performance and cost. Core stack is Azure Databricks and Azure Data Factory; hybrid in-office/WFH role in Calgary or Edmonton.
Senior Data Engineer to design and optimize data pipelines including implementing Data Lakehouse architectures and optimizing ETL workflows
Our power & utilities client is seeking a Senior Data Engineer to design and optimize data pipelines including implementing Data Lakehouse architectures and optimizing ETL workflows
Calgary or Edmonton candidates preferred. Hybrid work model of in-office and WFH
Must Haves
- 10+ years as a Data Engineer with deep expertise in cloud-based data platforms and analytics enablement programs
- Experience in Data Bricks, and Azure Data Factory building robust, scalable data pipelines
- Experience implementing data lakehouse architectures and optimizing ETL workflows for performance and cost efficiency
- Experience applying data governance and quality checks to ensure accuracy and compliance.
- Experience collaborating with Data Architects, Data Scientists, and Analysts to deliver secure, reliable, and accessible data for analytical products.
Strong Nice to Have
- ITIL service delivery framework and change management processes
- Relevant certifications in data engineering or cloud platforms
- Machine learning techniques and tools
- Data governance principles and practices
Responsibilities
- Design and develop scalable data pipelines to process and manage large datasets
- Integrate data from databases, APIs, and third-party systems
- Design and implement data warehousing solutions for analytics and reporting
- Optimize data processing systems for performance and cost efficiency
- Implement data quality checks and governance practices
- Maintain documentation for data infrastructure, processes, and systems
- Collaborate with application, security, infrastructure, operational support, and project teams to resolve technical issues
Our power & utilities client is seeking a Senior Data Engineer to design and optimize data pipelines including implementing Data Lakehouse architectures and optimizing ETL workflows
Calgary or Edmonton candidates preferred. Hybrid work model of in-office and WFH
Must Haves
- 10+ years as a Data Engineer with deep expertise in cloud-based data platforms and analytics enablement programs
- Experience in Data Bricks, and Azure Data Factory building robust, scalable data pipelines
- Experience implementing data lakehouse architectures and optimizing ETL workflows for performance and cost efficiency
- Experience applying data governance and quality checks to ensure accuracy and compliance.
- Experience collaborating with Data Architects, Data Scientists, and Analysts to deliver secure, reliable, and accessible data for analytical products.
Strong Nice to Have
- Azure cloud platform experience
- ITIL service delivery framework and change management processes
- Relevant certifications in data engineering or cloud platforms
Responsibilities
- Design and develop scalable data pipelines to process and manage large datasets
- Integrate data from databases, APIs, and third-party systems
- Design and implement data warehousing solutions for analytics and reporting
- Optimize data processing systems for performance and cost efficiency
- Implement data quality checks and governance practices
- Maintain documentation for data infrastructure, processes, and systems
- Collaborate with application, security, infrastructure, operational support, and project teams to resolve technical issues
AI may be used in evaluating candidates.
This posting is for an existing vacancy.