Azure Data Platform Engineer - 19038
Summary
The Azure Data Platform Engineer will build and optimize scalable batch and streaming data pipelines using Azure Data Factory, Databricks, Python, and PySpark. The role involves managing event-driven architectures, ensuring data quality, and integrating AI models into enterprise systems.
Veritaz is a leading IT staffing solutions provider in Sweden, committed to advancing individual careers and aiding employers in ensuring the perfect talent fit. With a proven track record of successful partnerships with top companies, we have rapidly grown our presence in the USA, Europe, and Sweden as a dependable and trusted resource within the IT industry.
Assignment Description
We are looking for an experienced Azure Data Engineer
What You Will Work On
- Build scalable data pipelines using Azure Data Factory
- Develop data solutions with Azure Databricks
- Work with Azure Blob Storage
- Transform large datasets using Python and PySpark
- Process structured and unstructured service contract data
- Develop both batch and streaming data pipelines
- Work with event-driven architectures such as Azure Service Bus / Kafka
- Design and optimize data models in Databricks
- Work with Delta Lake, partitioning and performance tuning
- Build and maintain CI/CD pipelines using Azure DevOps
- Ensure data quality, monitoring and production reliability
- Develop API and system integrations
- Connect AI models with enterprise systems
- Troubleshoot and optimize production data pipelines
What You Bring
- 5+ years of experience in data engineering
- Strong hands-on experience with Microsoft Azure
- Strong experience with Azure Data Factory
- Strong experience with Azure Databricks
- Advanced Python and PySpark skills
- Experience with Azure Blob Storage
- Experience with batch and streaming data processing
- Understanding of event-driven architectures
- Experience with Service Bus, Kafka or similar technologies
- Strong knowledge of data modelling and optimization
- Experience with Delta Lake, partitioning and performance tuning
- Experience building CI/CD pipelines with Azure DevOps
- Strong focus on data quality, monitoring and production reliability
- Experience with API and system integration
- Ability to integrate AI models with systems