Azure Data Engineer
Posted Updated 3
views
Summary
Build and maintain ETL/ELT pipelines on Azure using Databricks, PySpark, and Delta Lake to move and transform data for analytics and reporting.
Responsibilities
- Design, develop, and maintain ETL/ELT pipelines using Azure Databricks and PySpark
- Work with Azure services: ADF, ADLS, Azure SQL, Synapse, Key Vault
- Implement Delta Lake and manage data lake house architecture
- Collaborate with data architects, analysts, and business stakeholders
- Deploy solutions using CI/CD pipelines (Azure DevOps preferred)
Required Skills
- Strong experience with Azure Databricks, PySpark, Spark SQL
- Hands-on with Azure Data Factory, Delta Lake, ADLS Gen2
- Proficient in SQL, data modeling, and data governance principles
- Experience with devops and Terraform
- Familiarity with Lakehouse architecture and Unity Catalog (bonus)