Senior Software Developer – ETL
Summary
Contract Senior ETL Developer (placed by Upstaff) for the Ontario Government, 100% onsite in Toronto: designs, builds and maintains data pipelines, data models and database backends for a data warehouse/BI environment using Azure Data Factory, Azure SQL, Databricks, AWS data services and complex SQL. Runs Jan 5 – Oct 5, 2027, 5 days/week onsite.
- Design, develop, maintain, and continuously enhance ETL applications and database backend solutions for Data Warehouse and Business Intelligence environments.
- Design and implement scalable data extraction, transformation, and loading pipelines.
- Develop ETL functionality supporting both initial and daily/incremental data loads.
- Work with structured and semi-structured files, relational databases, and multi-dimensional data stores.
- Develop, implement, and maintain ETL scheduling and dependency logic.
- Perform data integration, data cleansing, transformation, and data analytics activities.
- Design and implement data models for data marts and enterprise data warehouses.
- Apply appropriate software development patterns, standards, and best practices.
- Develop high-quality, maintainable, and scalable code.
- Construct complex SQL queries and perform database and query performance tuning.
- Support database management and administration activities.
- Test, debug, troubleshoot, and resolve technical issues throughout the software development lifecycle.
- Translate technical specifications and business requirements into working, tested applications.
- Collaborate with business stakeholders, subject matter experts, clients, and IT professionals.
- Elicit, document, validate, and analyze business and technical requirements.
- Prepare detailed technical documentation, including ETL source-to-target mappings, data model diagrams, architecture artifacts, and detailed design documents.
- Participate throughout the SDLC from development through testing, quality assurance, implementation, and delivery.
- Provide technical assistance during implementation, conversion, migration, and post-implementation activities.
- Communicate technical information clearly to both technical and non-technical stakeholders.
- Investigate data and ETL pipeline issues, communicate potential impacts to end users, and recommend appropriate solutions.
Requirements
- Azure Data Factory (ADF)
- Azure SQL Database
- Azure Data Lake
- Power BI
- Databricks Platform
- Amazon Aurora
- Amazon Relational Database Search
- AWS Glue
- OpenSearch
- Related AWS data services
- Development of data extraction, transformation, and load (ETL) programs.
- Experience supporting both daily and initial data loads.
- Experience working with a broad range of data repositories, including:
- Structured files
- Semi-structured files
- Relational data stores
- Multi-dimensional data stores
- Developing, implementing, and maintaining schedule and dependency logic for ETL scripts.
- Data integration
- Data cleansing
- Data transformation
- Data analytics
- Data investigation and issue identification
- Ensuring high-quality, accurate, business-ready data
- Data modelling and design principles for:
- Data marts
- Data warehouses
- Designing scalable and maintainable data architectures.
- Database management and administration.
- Strong understanding of relational and database technologies.
- Strong experience constructing complex SQL queries.
- Experience with SQL performance tuning and optimization.
- ETL source-to-target mappings
- Data model diagrams
- Architecture artifacts
- Detailed design documents
- Technical/system documentation
- User documentation as required
- Git
- Knowledge of source-control strategies and practices.
- Experience eliciting, documenting, and validating business requirements.
- Experience working through the complete Software Development Life Cycle (SDLC):
- Development
- Testing
- Quality Assurance
- Delivery/Implementation
- Excellent verbal and written communication skills.
- Ability to understand, comprehend, and follow detailed instructions and requirements.
- Ability to communicate clearly and effectively with technical teams, clients, business stakeholders, and subject matter experts.
- Programming and software analysis.
- Designing, coding, testing, debugging, and documenting applications.
- Application design and current design patterns.
- Application deployment and troubleshooting.
- Object-oriented and/or third-generation programming languages.
- Relational and hierarchical database technologies.
- Query languages and information retrieval packages.
- Structured methodologies for application design, development, implementation, and maintenance.
- Collaborating with IT professionals throughout the SDLC.
- Gathering and documenting information from diverse business stakeholders and SMEs.
- Troubleshooting technical problems related to software packages and applications.
- Implementation, conversion, and migration activities.
- Meeting project deadlines while working effectively as part of a team.
- Knowledge and understanding of AODA (Accessibility for Ontarians with Disabilities Act) and related regulations and standards.
- Experience designing visual dashboards highlighting trends and KPIs.
- Experience developing scheduled and ad-hoc/canned reports.
- Experience with C#.
- Experience developing application code such as:
- APIs
- Functions
- Related application services
- Experience with PowerShell and other scripting languages.
- Knowledge of Internet-ready application development.
- Experience with Rapid Application Development (RAD) methodologies.
- Knowledge of Information Management principles, concepts, policies, and practices.
- Experience with middleware and gateways.
- Experience reviewing, analyzing, and modifying product installation scripts, including encoding, testing, and debugging.
- Experience providing post-implementation support and resolving technical issues.
- Experience conducting design walkthroughs with project teams.
- Experience preparing user and system documentation.
- 5 days per week onsite
- 222 Jarvis Street, Toronto
- 7.25 hours per calendar day
- Monday to Friday
- Within the standard working window of 8:00 AM to 5:00 PM, excluding lunch
- No remote/hybrid arrangement is indicated for this assignment.
- ✅ Azure Data Factory
- ✅ Azure SQL Database
- ✅ Azure Data Lake
- ✅ Power BI
- ✅ Databricks
- ✅ AWS / Amazon Aurora
- ✅ AWS Glue
- ✅ OpenSearch / relevant AWS search technology
- ✅ ETL development – initial & daily loads
- ✅ Structured & semi-structured data
- ✅ ETL scheduling/dependency logic
- ✅ Data integration & cleansing
- ✅ Data analytics
- ✅ Data modelling
- ✅ Data marts & data warehouses
- ✅ Database administration
- ✅ Complex SQL
- ✅ SQL performance tuning
- ✅ Git/source control
- ✅ ETL source-to-target mapping documentation
- ✅ Data model/architecture documentation
- ✅ Business requirements elicitation/documentation/validation
- ✅ Full SDLC experience
- ✅ Strong verbal & written communication
- ✅ 100% onsite – 222 Jarvis Street, Toronto
- ✅ CRJMC
- ⭐ AODA
- ⭐ Power BI dashboards/KPIs/reporting
- ⭐ C# / APIs / Functions
- ⭐ PowerShell/scripting