RQ11048 – DataOps/Cloud Data Engineer – Senior
Summary
Senior DataOps/Cloud Data Engineer building and automating ETL data pipelines using Informatica, Azure Data Factory, and Databricks with Medallion Architecture for a government ministry.
Ministry of Public and Business Service Delivery and Procurement
Community Services Cluster
777 Bay St, Toronto
Must Have:
- Experience developing ETL processes with Informatica, Azure Data Factory and Databricks (Python, Lakeflow, and SQL Optimization)
- Experience with solution development with Databricks in Medallion Architecture.
- Experience with Cloud data engineer must be familiar and experienced with different programming languages (Python, SQL, t-SQL, PL/SQL, Informatica, ADF, SSIS. Microsoft Fabric) and be able to integrate with many different platforms to create data pipelines, jobs, automate tasks, and write scripts.
- Experience with Data pipeline and workflow development, orchestration, deployment, and automation and specializing in programming and pipelines to create and managing the dataflow, Delta Lake indexing, parallelism and movement of data.