Data Engineer
Summary
Designs and builds Azure-based data pipelines and cloud data platforms using Microsoft Fabric, SQL, and ETL/ELT processes to modernize enterprise reporting and analytics.
We are seeking expression of interests for Data Engineers to join our team on an initial contract in August / September timeframe to support an Azure data platform transformation program.
This position will require you to design, build and optimise a modern cloud based data platform that supports enterprise reporting, analytics, operational processes and future capabilities.
Typical Duties May Include
- Design, develop and support Azure-based data integration and processing solutions.
- Build and maintain Azure Data Factory (ADF) pipelines for ingestion, transformation and orchestration of data.
- Develop and optimise SQL-based ETL/ELT processes.
- Support the modernisation of existing data warehouse environments and data services.
- Design and implement scalable data models and data processing frameworks.
- Assist with migration of on-premise data solutions to Azure-hosted platforms.
- Perform data validation, reconciliation and quality assurance activities.
- Optimise database performance and data processing workloads.
- Develop monitoring, alerting and operational support capabilities.
- Contribute to CI/CD, deployment automation and infrastructure-as-code initiatives where applicable.
- Produce technical documentation and support knowledge transfer activities.
- Collaborate with architects, reporting specialists, business analysts and project stakeholders to deliver high-quality outcomes.
Technical Skills Should
- Microsoft Fabric
- ETL, SQL, T-SQL, SSIS
- Experience working in modernisation programs
- Experience working in highly regulated environments