Data Engineer – Senior
Summary
Senior Data Engineer builds and maintains Azure-based data pipelines and analytics-ready datasets for Alberta’s Digital Regulatory Assurance System, using Databricks, Synapse, and PySpark.
Data Engineer – Senior
Client: Government of Alberta – Technology and Innovation
Project: Digital Regulatory Assurance System (DRAS)
Location: Edmonton, Alberta
Work Location: 9942 – 108 ST, Edmonton, AB T5K 2J5
Contract & Schedule
- Hours: 36.25 hours/week
- Daily Hours: 7.25 hours/day
- Working Hours: 8:15 AM – 4:30 PM Alberta Time, Monday–Friday
- Work Mode: Primarily Remote
- Onsite: Edmonton meetings approximately 3–4 times per fiscal month or more, as required
- Work Location Restriction: Resource must work from within Canada.
- Extension: Up to 6 months
Role Overview
The Data Engineer will support the DRAS modernization initiative, designing, building, and operating reliable data pipelines and data products. The role focuses on integrating data into the Data Management Platform, applying transformations, ensuring data quality and governance, and producing trusted analytics-ready datasets.
Key Responsibilities
- Design scalable and secure Azure data architectures
- Develop data pipelines using Azure Data Factory, Azure Databricks and Azure Synapse
- Manage Azure Data Lake Storage Gen2
- Integrate data from systems such as ServiceNow and geospatial platforms
- Build data models, semantic layers, data marts and analytics-ready datasets
- Develop ETL/ELT workflows using Python, PySpark and SQL
- Work with Azure API Management and REST APIs
- Implement data governance, metadata, classification and lineage
- Apply security controls including RBAC, encryption and data masking
- Monitor and troubleshoot pipelines for reliability and performance
- Use AI/automation tools for code generation, testing, monitoring and documentation
- Develop standardized datasets supporting analytics and future AI use cases.
Requirements
Must-Have Qualifications
| Requirement | Experience |
|---|---|
| Computer Science or related post-secondary education | Required |
| Data solutions for trusted, analytics-ready datasets, semantic layers/data marts/data products | 3+ years |
| Git/GitHub version control | 4+ years |
| Azure Storage, SQL, Synapse, networking & secure authentication | 3+ years |
| Python/PySpark & SQL for Data Engineering | 5+ years |
| Azure Databricks & Delta Lake | 3+ years |
| AI for code generation, data analysis and automation | 1+ year |
Nice-to-Have
- Data/business requirements analysis – 6 years
- Microsoft SQL Server – 6 years
- Microsoft Fabric – 2 years
- Government of Alberta Cloud data products – 1 year
- RESTful API design/integration – 3 years
- Message queuing technologies such as ActiveMQ / Azure Service Bus – 3 years
- Cross-functional software/data product development – 5 years