Azure Data Engineer
Summary
Build and optimize Azure-based ETL pipelines using Python, PySpark, and Azure Data Factory to migrate streaming data to batch storage in ADLS.
Data Engineer – Streaming to Batch Migration (Azure)
Location: Madrid, Community of Madrid, Spain
Responsibilities:
- Design and implement Azure Data Factory and manage Azure Data Lake storage (ADLS).
- Build ETL data pipelines using Python, Scala, and PySpark.
- Optimize data models.
Seniority level
- Mid-Senior level
Employment type
- Full-time
Job function
- Engineering and Information Technology
Industry
- IT Services and IT Consulting