Azure Data Engineer
Summary
Builds and maintains ETL/ELT pipelines in Azure using Databricks, PySpark, and Azure services like ADF, Synapse, and SQL, while ensuring data lakehouse architecture and governance.
Responsibilities
Vergeet niet uw cv te controleren voordat u solliciteert. Zorg er ook voor dat u alle vereisten met betrekking tot deze functie doorleest.
Required Skills
Vergeet niet uw cv te controleren voordat u solliciteert. Zorg er ook voor dat u alle vereisten met betrekking tot deze functie doorleest.
- Design, develop, and maintain ETL/ELT pipelines using Azure Databricks and PySpark
- Work with Azure services: ADF, ADLS, Azure SQL, Synapse, Key Vault
- Implement Delta Lake and manage data lake house architecture
- Collaborate with data architects, analysts, and business stakeholders
- Deploy solutions using CI/CD pipelines (Azure DevOps preferred)
Required Skills
- Strong experience with Azure Databricks, PySpark, Spark SQL
- Hands-on with Azure Data Factory, Delta Lake, ADLS Gen2
- Proficient xgiwjmb in SQL, data modeling, and data governance principles
- Experience with devops and Terraform
- Familiarity with Lakehouse architecture and Unity Catalog (bonus)