Data Engineer
Summary
Builds and maintains data pipelines and warehouses on Azure, using Spark, SQL, and ETL tools to enable analytics and reporting.
Location: Krakow/Wroclaw, Poland (Hybrid 3 Days in a week)
Job Type: Contract (B2B/Freelancing)
Job Description
Required skills and experience
- 8-10 years of hands-on experience in data engineering space, with ability to translate working solution into implementable working package and/or built new solution using Azure platform
- High proficiency and experience in designing/developing data analytics and data warehouse solutions with Azure Data Factory (ADF) and Azure Databricks, services related to Azure Analytics, Azure data lake storage Gen2, Azure SQL/Postgres, Azure analytics services and good understanding of Azure identity (SPN, SAMI, UAMI etc.)
- Proficient coding experience using Spark (Python/Scala) and SQL.
- Hands on experience with one of scripting language: Linux / PowerShell.
- Prior ETL development experience using industry tool e.g. informatica/SSIS/Talend etc., good to have knowledge in Kafka streaming Azure Infrastructure
- A proven track of work experience in cloud (MS Azure platform preferred) in an agile SDLC environment, leveraging modern programming languages, DevOps, and test-driven development