Azure Data Engineer — Streaming to Batch Pipelines
Summary
Design and implement Azure-based streaming-to-batch data pipelines using Data Factory, Data Lake Storage, and PySpark/Python.
MPower Plus is seeking a Data Engineer specializing in Streaming to Batch Migration in Madrid.
Desplácese hacia abajo para ver todos los requisitos del puesto y las responsabilidades que pueden esperar los candidatos seleccionados.
You will design and implement solutions using Azure Data Factory and manage Azure Data Lake Storage while optimizing data models.
This full-time position requires a mid-senior level of expertise, with responsibilities including building ETL pipelines in Python, Scala, and PySpark. xqbhyrx
The ideal candidate will have proven experience in designing and implementing data pipelines.