Data Engineer (Platform) | Relocation to Barcelona
Summary
Senior Data Platform Engineer at Capitole, relocating to Barcelona, to build and operate a modern Azure-based Lakehouse platform: owning Apache Airflow, migrating from Azure Data Factory, managing Terraform IaC, Databricks/Unity Catalog and CI/CD with Azure DevOps — a hands-on mix of data engineering, cloud platform engineering and DevOps.
Capitole is growing, and we're looking for a Senior Data Platform Engineer to join our team and help shape the future of a modern Azure-based Data Platform!
We are looking for an experienced engineer who enjoys building, evolving and operating data platforms, with a strong focus on cloud infrastructure, orchestration, automation and governance.
You will play a key role in the evolution of a Lakehouse architecture, working on platform foundations that enable data engineering teams to build and deliver reliable, scalable and efficient data products.
This is a hands-on engineering role combining Data Engineering, Cloud Platform Engineering and DevOps.
What will you do?
- Own and evolve the Apache Airflow platform, including environments, deployments, DAG standards, monitoring and reliability.
- Contribute to the migration from Azure Data Factory (ADF) to Apache Airflow.
- Develop metadata-driven orchestration frameworks, reusable operators and automated DAG generation.
- Manage Azure resources using Terraform and Infrastructure as Code.
- Work with Azure Key Vault, Managed Identities, Service Principals, Entra ID and RBAC.
- Manage CI/CD pipelines and multi-environment deployments using Azure DevOps.
- Operate and optimize Azure Databricks, Unity Catalog, Delta Lake and Data Lake Storage.
- Improve platform observability, monitoring, alerting, performance and cost efficiency.
- Contribute to Data Catalog, Data Quality and data lineage initiatives.
- Participate in architecture decisions, technical reviews and engineering standards.
- Collaborate with Data Engineers, Architects and Product Owners to continuously improve the platform.
What are we looking for?
- 6+ years of experience in Data Engineering, Data Platform Engineering or Cloud Engineering.
- Strong knowledge of Python, SQL and PySpark.
- Hands-on experience with Apache Airflow in production environments.
- Experience with Azure services, especially:
- Azure Data Factory and Azure Data Lake Storage (ADLS).
- Azure Key Vault and identity management.
- Azure RBAC and Entra ID.
- Azure DevOps and CI/CD pipelines.
- Strong experience with Terraform and Infrastructure as Code.
- Hands-on experience with Azure Databricks, Delta Lake and Unity Catalog.
- Knowledge of Lakehouse architecture, Medallion architecture and metadata-driven frameworks.
- Experience with monitoring, observability and production troubleshooting.
- Good communication skills and the ability to collaborate with different technical teams.
Nice to have
- Experience migrating orchestration workloads from ADF to Airflow.
- Experience building reusable orchestration frameworks and metadata-driven DAGs.
- Airflow deployments on Kubernetes or experience with AKS.
- Knowledge of FinOps practices and Azure/Databricks cost optimization.
- Experience with AI-assisted engineering workflows, MCP, AI agents or automated code reviews.
Why join Capitole?
- Permanent contract from day one.
- €1,200 annual budget for professional development and certifications.
- Private health insurance fully covered by Capitole.
- Monthly feedback and continuous career development.
- Wellhub membership and Payflow benefits.
- Tech communities, team events and an international environment.
At Capitole, we believe in people, technical excellence and building strong teams. You'll have the opportunity to work on challenging projects, influence technical decisions and grow alongside talented professionals.
Interested in taking your Data Platform Engineering career to the next level?
#Capitole #Hiring #DataEngineering #DataPlatform #Azure #Databricks #ApacheAirflow #Terraform #PySpark #CloudEngineering #BarcelonaJobs
Skills
- Agentic AI
- AI
- Airflow
- AKS
- Automation
- Azure
- Azure Data Factory
- Azure DevOps
- CI/CD
- Cloud
- Data Engineering
- Data Lake
- Data Lineage
- Data Quality
- Databricks
- Delta Lake
- DevOps
- Entra ID
- FinOps
- IAM
- Infrastructure as Code
- Kubernetes
- Lakehouse
- MCP
- Medallion Architecture
- Observability
- PySpark
- Python
- RBAC
- SQL
- Terraform
- Unity
- Unity Catalog
- Vault
Sign in to read and join the discussion.