Data Engineer - Azure Synapse - Sydney
Greetings!!
We have an urgent opening for “ Data Engineer - Azure Synapse”- Sydney, Australia. Please let me know your interest. Also you can refer me if anyone is interested contact at seek at 0391110296/ 0260750102 or : seek@silverlinktechnologies.com
Role –Data Engineer - Azure Synapse
Location –Sydney, Australia
Duration:- Contract
Key Responsibilities
Design, develop and maintain scalable data pipelines and ETL/ELT solutions using Azure Data Factory (ADF) and Azure Synapse Analytics.
Develop data ingestion and transformation pipelines from various sources into Azure Data Lake Storage Gen2 (ADLS) and Synapse.
Work extensively with Azure Synapse SQL Pools – Dedicated and Serverless for data warehousing and analytics workloads.
Develop complex T-SQL queries, stored procedures, views and performance-optimized data models.
Build and maintain Synapse Pipelines, datasets, linked services, triggers and Mapping Data Flows.
Develop data transformation solutions using Synapse Spark / PySpark where required.
Implement incremental data loads, CDC, SCD Type 1/2 and data validation processes.
Optimize Synapse queries, tables, distributions, partitioning and data loading strategies.
Integrate data from SQL Server, Azure SQL, APIs, files and other cloud/on-premise sources.
Implement monitoring, error handling, logging and alerting for production data pipelines.
Work with Azure DevOps/Git and CI/CD pipelines for deployment and release management.
Ensure data security using Azure Key Vault, Managed Identity, RBAC and appropriate access controls.
Mandatory Skills
Strong hands-on experience as an Azure Data Engineer.
Excellent experience with Azure Synapse Analytics.
Strong Azure Data Factory (ADF) experience.
Strong SQL / T-SQL skills.
Experience with Azure Data Lake Storage Gen2 (ADLS Gen2).
Experience developing and optimizing ETL/ELT pipelines.
Experience with Synapse SQL – Dedicated/Serverless SQL Pools.
Good understanding of data warehousing concepts, dimensional modelling and star/snowflake schemas.
Experience with Azure DevOps, Git and CI/CD.
Strong troubleshooting and performance-tuning skills.