Cloud Data Engineer (f/m/x)
Posted 9
views
Summary
Builds and develops scalable data processing platforms and ETL/ELT pipelines in Azure Databricks within Sii Poland's Data & Analytics Competence Center. Day to day: data modeling, batch/near real-time pipeline work, monitoring and optimization, and collaborating with analysts and data science teams.
Do you want to develop your skills in cloud technologies? Join our specialized unit focusing on experts in data processing and analysis within the Data & Analytics Competence Center. We also offer development in the areas of Data Science, Big Data, and Machine Learning.
Your tasks
- Designing, building, and developing scalable and high-performance data processing platforms in Data Lake / Data Platform architecture
- Creating and maintaining ETL/ELT pipelines for data integration from various sources and processing them in the Azure Databricks environment
- Data modeling and preparing data structures tailored to analytical and business needs
- Implementing solutions for data processing (batch and/or near real-time)
- Monitoring, optimizing, and developing existing pipelines and data processing processes
- Collaborating with data analysts, BI teams, and Data Science on data preparation and sharing
- Gathering business requirements and proposing optimal technological solutions
- Creating and maintaining technical documentation for developed solutions