Azure Data Engineer
We are seeking a skilled Azure Data Engineer to design, develop, and maintain scalable cloud-based data solutions on the Microsoft Azure platform. The ideal candidate will have expertise in data integration, ETL/ELT pipelines, big data technologies, and cloud data warehousing to support analytics and business intelligence initiatives.
Key Responsibilities
- Design and implement scalable data pipelines using Azure services.
- Develop and maintain ETL/ELT workflows for structured and unstructured data.
- Build and optimize data solutions using Azure cloud technologies.
- Integrate data from multiple sources including APIs, databases, flat files, and streaming platforms.
- Create and manage data lakes, data warehouses, and medallion architectures.
- Ensure data quality, governance, security, and compliance standards.
- Monitor and troubleshoot production data workflows and performance issues.
- Collaborate with data analysts, DevOps, and business stakeholders.
- Implement CI/CD pipelines and infrastructure automation for data platforms.
- Optimize SQL queries and improve overall data processing performance.
Requirements
Technical Skills
- Strong experience with:
- Azure Data Factory (ADF)
- Azure Databricks
- Azure Synapse Analytics
- Azure Data Lake Storage (ADLS)
- Azure SQL Database
- Azure Functions
- Azure Event Hub / Service Bus
- Azure Data Factory (ADF)
- Proficiency in:
- SQL
- Python / PySpark
- Scala (optional)
- SQL
- Experience with:
- ETL/ELT pipeline development
- Data modeling and warehousing concepts
- Spark-based distributed processing
- REST APIs and data integration
- Git, CI/CD, and DevOps practices
- ETL/ELT pipeline development
Benefits
Standard Company Benefits