Senior Data Engineer: Databricks & Azure Pipelines
Summary
Designs and builds scalable data pipelines on Databricks and Azure, using Python/PySpark and Azure Data Factory to integrate and process large datasets.
Sii Poland is seeking a Senior Big Data Developer to join our team in building a modern data platform using Databricks and the Microsoft Azure ecosystem. You will design and develop scalable data solutions, implementing and optimizing ETL/ELT pipelines, and integrating data from multiple sources.
You will work with Databricks, Python, and PySpark; leverage Azure Data Factory and Azure Event Hub; explore AI-assisted development tools to enhance code quality, testing, and documentation.