Azure Data Engineer — Streaming to Batch Pipelines
Summary
Design and implement Azure-based streaming-to-batch data pipelines using Data Factory, Data Lake Storage, and PySpark/Scala in Python.
MPower Plus is seeking a Data Engineer specializing in Streaming to Batch Migration in Madrid. You will design and implement solutions using Azure Data Factory and manage Azure Data Lake Storage while optimizing data models.
This full-time position requires a mid-senior level of expertise, with responsibilities including building ETL pipelines in Python, Scala, and PySpark. The ideal candidate will have proven experience in designing and implementing data pipelines.