Sr Data Engineer
Summary
Senior Data Engineer builds and optimizes Azure Databricks pipelines for batch and streaming data in the automotive industry, using Python, PySpark, and SQL.
Client: automotive industry
Hourly Rate: up to 145 PLN
Location: Wroclaw, Poland
Work arrangement: hybrid, twice per week in the office or to be determined, full-time
We are looking for a Senior Data Engineer with strong expertise in Azure Databricks. The ideal candidate will be skilled in building and optimizing data solutions, with excellent analytical abilities and a strong focus on communication and collaboration with business stakeholders, internal teams, and external partners.
Responsibilities:
- Design, build, and optimize data pipelines using Azure Databricks.
- Work with batch and streaming data processing.
- Collaborate with business stakeholders, internal teams, and external partners.
- Implement and maintain workflows and data solutions.
- Use Azure DevOps for CI/CD processes (Repos, Pipelines, YAML).
- Manage data with Unity Catalog.
Requirements:
- Proven experience with Azure Databricks (data engineering, pipelines, performance tuning).
- Strong skills in Python, PySpark, and SQL.
- Experience with batch and streaming data.
- Familiarity with Azure DevOps (Repos, Pipelines, YAML).
- Experience with Unity Catalog.
- Excellent communication and stakeholder management skills.
- Experience with SQL Server is a plus.
If you meet most of the requirements and are looking for your next challenge, we’d love to hear from you - feel free to apply below!