Senior Data Architect / Senior Data Engineer – Azure Databricks
Description
Freelance · Remote, occasionally Zurich · 80–100% · Start as soon as possible · Currently planned until end of 2027
About the project
Our client, a large Swiss media company, is building a new platform on Azure Databricks for the usage data of its apps and websites. It will replace the commercial analytics tool they use today. Analysts are starting to work on the new platform now.
Your role
You join the platform team of five developers through Xebia. Most of your time goes into implementing Jira tickets. You build and run the pipelines that take event data from Azure Event Hubs through the bronze, silver and gold layers into the tables analysts and dashboards use. You keep the Databricks and Azure infrastructure in code with Pulumi and ship changes through GitHub Actions. The team creates and refines tickets together and reviews each other's code. You'll also help analysts get started with Databricks and GitHub.
As the senior person in the team, you can advise on anything from implementation details to the overall architecture, while the product owner sets the priorities. Today the role also covers the data model, the infrastructure and the platform costs, and there is room to take on more responsibility over time. The team uses AI coding assistants such as Claude in its daily work.
Must-have
- Several years of hands-on data engineering on Databricks: building and running production pipelines with Spark, PySpark or SQL and Delta Lake, in a medallion architecture
- Architecture experience on a Databricks or Azure data platform
- Streaming or event ingestion, ideally Azure Event Hubs or Kafka
- Data modelling for analytics and BI
- Infrastructure as code, ideally Pulumi (Terraform experience transfers)
- Git, GitHub workflows and CI/CD with GitHub Actions
- Experience in larger projects
- You work well in a team and get productive with little onboarding
- Comfortable using AI coding assistantsFluent English
Nice-to-have
- Unity Catalog, Databricks Asset Bundles, data quality frameworks
- Dashboards in Databricks or Power BI
- Azure experience beyond Databricks
- Web and app usage tracking or digital analytics, including tracking migrations
- Media or broadcasting experience
- German
Details
The current engineer can hand over until the end of January. English is the working language; German is a plus.
We look forward to meeting you!
Skills
Sign in to read and join the discussion.