Senior Data Engineer to design and optimize data pipelines including implementing Data Lakehouse arc
Posted 1
view
S I Systems Senior Data Engineer to design and optimize data pipelines including implementing Data Lakehouse arc
Summary
Senior Data Engineer focused on designing and optimizing data pipelines and Data Lakehouse architectures. Key responsibilities include building scalable ETL workflows using Databricks and Azure Data Factory within a cloud-based environment for a power and utilities client.
Senior Data Engineer to design and optimize data pipelines including implementing Data Lakehouse architectures and optimizing ETL workflows
Our power & utilities client is seeking a
Senior Data Engineer to design and optimize data pipelines including implementing Data Lakehouse architectures and optimizing ETL workflows
Calgary or Edmonton candidates preferred. Hybrid work model of in-office and WFH
Must Haves
10+ years as a
Data Engineer
with deep expertise in
cloud-based data platforms
and
analytics enablement
programs
Experience in
Data Bricks, and Azure Data Factory
building
robust, scalable data pipelines
Experience implementing
data lakehouse architectures
and optimizing
ETL workflows
for performance and cost efficiency
Experience applying
data governance
and
quality checks
to ensure accuracy and compliance.
Experience collaborating with Data Architects, Data Scientists, and Analysts to deliver
secure, reliable, and accessible data
for analytical products.
Strong Nice to Have
ITIL service delivery framework and change management processes
Relevant certifications in data engineering or cloud platforms
Machine learning techniques and tools
Data governance principles and practices
Responsibilities
Design and develop scalable data pipelines to process and manage large datasets
Integrate data from databases, APIs, and third-party systems
Design and implement data warehousing solutions for analytics and reporting
Optimize data processing systems for performance and cost efficiency
Implement data quality checks and governance practices
Maintain documentation for data infrastructure, processes, and systems
Collaborate with application, security, infrastructure, operational support, and project teams to resolve technical issues
Our power & utilities client is seeking a
Senior Data Engineer to design and optimize data pipelines including implementing Data Lakehouse architectures and optimizing ETL workflows
Calgary or Edmonton candidates preferred. Hybrid work model of in-office and WFH
Must Haves
10+ years as a
Data Engineer
with deep expertise in
cloud-based data platforms
and
analytics enablement
programs
Experience in
Data Bricks, and Azure Data Factory
building
robust, scalable data pipelines
Experience implementing
data lakehouse architectures
and optimizing
ETL workflows
for performance and cost efficiency
Experience applying
data governance
and
quality checks
to ensure accuracy and compliance.
Experience collaborating with Data Architects, Data Scientists, and Analysts to deliver
secure, reliable, and accessible data
for analytical products.
Strong Nice to Have
Azure cloud platform experience
ITIL service delivery framework and change management processes
Relevant certifications in data engineering or cloud platforms Responsibilities
Design and develop scalable data pipelines to process and manage large datasets
Integrate data from databases, APIs, and third-party systems
Design and implement data warehousing solutions for analytics and reporting
Optimize data processing systems for performance and cost efficiency
Implement data quality checks and governance practices
Maintain documentation for data infrastructure, processes, and systems
Collaborate with application, security, infrastructure, operational support, and project teams to resolve technical issues
Disclaimer: AI may be used in evaluating candidates. This posting is for an existing vacancy.
Senior Data Engineer to design and optimize data pipelines including implementing Data Lakehouse architectures and optimizing ETL workflows
Calgary or Edmonton candidates preferred. Hybrid work model of in-office and WFH
Must Haves
10+ years as a
Data Engineer
with deep expertise in
cloud-based data platforms
and
analytics enablement
programs
Experience in
Data Bricks, and Azure Data Factory
building
robust, scalable data pipelines
Experience implementing
data lakehouse architectures
and optimizing
ETL workflows
for performance and cost efficiency
Experience applying
data governance
and
quality checks
to ensure accuracy and compliance.
Experience collaborating with Data Architects, Data Scientists, and Analysts to deliver
secure, reliable, and accessible data
for analytical products.
Strong Nice to Have
ITIL service delivery framework and change management processes
Relevant certifications in data engineering or cloud platforms
Machine learning techniques and tools
Data governance principles and practices
Responsibilities
Design and develop scalable data pipelines to process and manage large datasets
Integrate data from databases, APIs, and third-party systems
Design and implement data warehousing solutions for analytics and reporting
Optimize data processing systems for performance and cost efficiency
Implement data quality checks and governance practices
Maintain documentation for data infrastructure, processes, and systems
Collaborate with application, security, infrastructure, operational support, and project teams to resolve technical issues
Our power & utilities client is seeking a
Senior Data Engineer to design and optimize data pipelines including implementing Data Lakehouse architectures and optimizing ETL workflows
Calgary or Edmonton candidates preferred. Hybrid work model of in-office and WFH
Must Haves
10+ years as a
Data Engineer
with deep expertise in
cloud-based data platforms
and
analytics enablement
programs
Experience in
Data Bricks, and Azure Data Factory
building
robust, scalable data pipelines
Experience implementing
data lakehouse architectures
and optimizing
ETL workflows
for performance and cost efficiency
Experience applying
data governance
and
quality checks
to ensure accuracy and compliance.
Experience collaborating with Data Architects, Data Scientists, and Analysts to deliver
secure, reliable, and accessible data
for analytical products.
Strong Nice to Have
Azure cloud platform experience
ITIL service delivery framework and change management processes
Relevant certifications in data engineering or cloud platforms Responsibilities
Design and develop scalable data pipelines to process and manage large datasets
Integrate data from databases, APIs, and third-party systems
Design and implement data warehousing solutions for analytics and reporting
Optimize data processing systems for performance and cost efficiency
Implement data quality checks and governance practices
Maintain documentation for data infrastructure, processes, and systems
Collaborate with application, security, infrastructure, operational support, and project teams to resolve technical issues
Disclaimer: AI may be used in evaluating candidates. This posting is for an existing vacancy.