Senior Azure data Engineer-Immediate

12 hr. ago 9 hr. ago

Synoptek Senior Azure data Engineer-Immediate

Key Responsibilities

Design, develop, and maintain scalable data pipelines and ETL/ELT solutions on Azure.
Build and manage data solutions using Microsoft Fabric, including:

Develop and optimize data processing solutions using PySpark.
Design and implement data integration workflows using Azure Data Factory (ADF).
Work with Azure Synapse Analytics for data warehousing, analytics, and large-scale data processing.
Develop and maintain solutions using Azure SQL.
Design and implement dimensional data models, including fact and dimension tables, star/snowflake schemas, and slowly changing dimensions.
Develop reusable and scalable data transformation frameworks.
Implement CI/CD pipelines for data engineering solutions using Azure DevOps or similar tools.
Apply data engineering best practices around data quality, security, governance, lineage, and access control.
Troubleshoot data pipeline failures and production issues and provide root-cause analysis.
Perform query, pipeline, storage, and compute performance optimization.
Work closely with data architects, analysts, application teams, and business stakeholders to understand data requirements.
Participate in code reviews, technical design discussions, and documentation.

Required Skills

Strong programming experience with Python and PySpark.
Good understanding of SQL and complex query development.
Strong knowledge of Dimensional Modeling and data warehouse concepts.
Experience with ETL/ELT architecture and data pipeline development.
Experience implementing CI/CD for data engineering projects.
Understanding of Data Governance, Data Quality, Security, and Data Lineage.
Strong understanding of performance optimization techniques for data pipelines, SQL queries, Spark jobs, and data warehouses.
Experience working with large datasets and distributed data processing.

Skills