Senior Data Engineer: Azure Databricks & CI/CD Pipelines
Summary
Design and build scalable data pipelines on Azure and Databricks, using Python, PySpark, and SQL, while implementing CI/CD in Azure DevOps.
Avenga Poland seeks a seasoned Data Engineer to design and implement end-to-end data pipelines using Azure, Databricks, and IICS. You will translate business requirements into scalable data solutions and optimize data processing for complex use cases.
The role requires strong Python, PySpark, SQL skills and hands-on experience with CI/CD in Azure DevOps, plus a solid grounding in data modeling within an Agile/Scrum team. On-site in Wrocław, with collaboration across stakeholders.