Data Engineer
Summary
Senior Data Engineer in Gdansk (onsite at least 2 days/week) who delivers data analysis and transformation on Microsoft Azure, builds and maintains ETL processes, and creates data pipelines for AI/ML use cases using Python/PySpark and SQL, while communicating data topics with stakeholders.
Summary: The role of Data Engineer focuses on replacing a consultant at the end of the year, with a senior profile who possesses skills in data and analytics, and who can communicate effectively with stakeholders.
Main Responsibilities:
* Deliver data analysis and data transformation using cloud platforms.
* Develop and maintain ETL processes.
* Create and optimize data pipelines for AI/ML applications.
* Peer communication with stakeholders on data-related topics.
Key Requirements:
* Solid experience with Microsoft Azure (e.g., Data Factory, Data Lake).
* Strong proficiency in Python/PySpark and SQL.
* Proven experience with ETL processes and data transformation.
Nice to Have:
* Experience with CI/CD, Terraform, and Unity Catalog.
* Knowledge of working with structured and unstructured data sets.
* Understanding of data pipelines that support AI/ML use cases.
Other Details:
* Location: Gdansk, Poland (at least 2 days/week).
* Timeframe: Ideal start 1/12, but flexible.
* Communicative skills: Strong English skills.