Senior Data Platform Engineer a.i.
Summary
Build and maintain a Databricks-based operational data platform for a large European transit agency, using Terraform, Azure, and real-time streaming pipelines.
Over onze klant
Lees hieronder meer over de algemene taken die bij deze functie horen, evenals de vereiste vaardigheden.
Our client is a large, innovative public transport organisation operating in a major European city. They are investing heavily in modernising their data and integration landscape to support real-time operational processes and future scalability.
Functie
- Design and implement an Operational Data Platform using Databricks Lakebase
- Build infrastructure using Terraform (Infrastructure as Code)
- Develop CI/CD pipelines for infrastructure and database deployments
- Implement transactional data storage for streaming and messaging flows
- Enable integration with the broader data platform via Unity Catalog
- Ensure performance, security, monitoring, and data reliability
Profiel
- 7+ years of PostgreSQL experience
- 5+ years in data platform engineering and Databricks
- Strong experience with Microsoft Azure (3+ years) xgiwjmb
- Hands-on with Terraform and CI/CD practices
- Experience with real-time data processing (1000+ TPS)
- Knowledge of streaming, messaging, and integration patterns
Aanbod
- ASAP
- North-Holland
- 32 - 40 hours
- 6 months with possible extension
Lees hieronder meer over de algemene taken die bij deze functie horen, evenals de vereiste vaardigheden.
Our client is a large, innovative public transport organisation operating in a major European city. They are investing heavily in modernising their data and integration landscape to support real-time operational processes and future scalability.
Functie
- Design and implement an Operational Data Platform using Databricks Lakebase
- Build infrastructure using Terraform (Infrastructure as Code)
- Develop CI/CD pipelines for infrastructure and database deployments
- Implement transactional data storage for streaming and messaging flows
- Enable integration with the broader data platform via Unity Catalog
- Ensure performance, security, monitoring, and data reliability
Profiel
- 7+ years of PostgreSQL experience
- 5+ years in data platform engineering and Databricks
- Strong experience with Microsoft Azure (3+ years) xgiwjmb
- Hands-on with Terraform and CI/CD practices
- Experience with real-time data processing (1000+ TPS)
- Knowledge of streaming, messaging, and integration patterns
Aanbod
- ASAP
- North-Holland
- 32 - 40 hours
- 6 months with possible extension