Senior Data Engineer with Azure at BeachHead
Summary
Senior Azure Data Engineer in Toronto supporting large-scale data projects in asset management/financial services. Day to day: building Azure Data Factory orchestrations with Databricks integrations, managing Unity Catalog governance, designing Delta Lake schemas with Medallion architecture, and optimizing Delta Live Tables.
This position calls for a seasoned professional ready to integrate advanced Databricks implementations within a dynamic team. You will support large-scale data projects, ensuring compliance and security, while leveraging your expertise in Azure Data Factory and related technologies to drive strategic decisions in the financial sector.
Key Responsibilities: • Develop Azure Data Factory orchestrations featuring Databricks integrations • Manage and configure Unity Catalog for robust data governance • Design Delta Lake schemas, ensuring security compliance • Load diverse datasets into Databricks via ADF with Medallion architecture • Optimize Delta Live Tables for performance and cost-effectiveness
Requirements: • Over 7 years’ experience with Azure Data Factory and Databricks • Proficient in Python, Spark, and Databricks notebooks • Expertise in Unity Catalog and data governance practices • Familiarity with Azure DevOps for CI/CD pipeline management • Strong communication and leadership abilities
Leverage your cloud data engineering skills to make impactful contributions in the financial industry with BeachHead.