Azure Data Engineer
Posted Updated
Description
- Help design, build and continuously improve the clients online platform.
- Research, suggest and implement new technology solutions following best practices/standards.
- Take responsibility for the resiliency and availability of different products.
- Be a productive member of the team.
Requirements
- Experienced Azure Data Engineer with strong expertise in Azure Data Factory, Azure Databricks, Python, and PySpark to design, develop, and maintain scalable cloud-based data engineering solutions.
- Design, develop, and maintain complex data pipelines using Azure Data Factory and Azure Databricks.
- Build and optimize large-scale data processing solutions using PySpark and Databricks.
- Develop and maintain Python-based ETL processes for data extraction, transformation, and loading.
- Implement CI/CD pipelines using Azure DevOps for automated testing, integration, and deployment.
- Collaborate with cross-functional teams to understand data requirements and deliver efficient data solutions.
- Monitor, troubleshoot, and optimize data pipelines to ensure performance, scalability, and reliability.
- Ensure data security, governance, and compliance with organizational standards.
- Stay updated with emerging technologies and best practices in Azure cloud data engineering.
- Strong hands-on experience with Azure Data Factory (ADF) for data orchestration and pipeline development.
- Expertise in Azure Databricks and large-scale data processing frameworks.
- Proficiency in Python and PySpark for big data processing and ETL development.
- Experience implementing CI/CD pipelines using Azure DevOps.
- Strong SQL skills and experience managing large datasets.
- Good understanding of cloud-based data engineering solutions.
- Excellent analytical, troubleshooting, communication, and documentation skills.
- Ability to work independently and collaboratively within cross-functional teams.
Benefits
Fixed Term Employment Contract
Work-Life Balance
Flexible Work Mode
What GeekSoft Consulting Offers
- International, collaborative consulting culture with clear career development paths.
- Comprehensive Dutch benefits package emphasizing well-being, mobility, and career growth.
Skills
Sign in to read and join the discussion.