Senior Data Engineer (.NET / Azure)
Posted
Summary
Senior Data Engineer building end-to-end data applications: designing data pipelines with Databricks and Azure data services, developing backend REST APIs in .NET 6+, and automating CI/CD with Git, Azure DevOps, and PowerShell. Requires 5+ years combining data and software engineering, plus cloud (Azure) ops and fluent English/Polish.
- Python
- Databricks
- .NET
- Spark
- Angielski (C1)
- Polski (C1)
- Agile
- 5+ years of hands-on experience combining Data Engineering with Software Engineering.
- Proven experience in Data Engineering using Databricks , Apache Spark, or Python.
- Strong proficiency in Web Development and backend engineering using .NET 6+ .
- Hands-on expertise with cloud infrastructure setup and administration, preferably Microsoft Azure .
- Experience with automated CI/CD pipelines , Version Control ( Git ), Azure DevOps, and PowerShell scripting.
- Fluent English communication skills for working in an international environment.
- Develop, enhance, and maintain end-to-end data applications, data engineering workflows, and cloud infrastructure features.
- Design and build data pipelines using Databricks alongside Azure data services.
- Develop backend solutions, RESTful APIs, and web services using .NET 6+.
- Build, maintain, and automate CI/CD pipelines using Git, Azure DevOps, and PowerShell scripting.
- Resolve data quality issues, troubleshoot system maintenance tickets, and ensure optimal operational performance across cloud systems.
- Perform system monitoring, logging, and diagnostics using Application Insights, Log Analytics, and API tools.