Senior Data Engineer
Posted 4
views
Summary
Builds, operates, and optimizes a modern Azure-based data platform in Barcelona — designing pipelines with Azure Data Factory, ADLS Gen2, Databricks, and Synapse, writing PySpark/Spark ETL jobs, and automating deployments via CI/CD across multi-tenant environments.
About the Role:
We are looking for an experienced and solution-orientedAzure Data Platform Engineerto develop, operate, and optimize our modern Azure-based data platform. In this role, you will focus onAzure, Databricks, data infrastructure, and CI/CD, supportingmulti-tenant environmentsand enabling reliable, scalable data solutions.
Main responsibilities:
- Develop a Modern Azure Data Platform: Design, build, and operate end-to-end data solutions using Azure Data Factory, Azure Data Lake Storage Gen2, Databricks, and Azure Synapse Analytics.
- Create Data Pipelines: Develop and maintain scalable ETL/ELT pipelines using PySpark and Spark, with a strong focus on data quality, reliability, and performance.
- Multi-Tenant & Environment Support: Support and operate multi-tenant data platforms across multiple environments (development, test, production) with clear separation and governance.
- Infrastructure & Platform Operations: Provision, configure, and maintain Azure data infrastructure, ensuring stability, security, and scalability.
- CI/CD for Data Platforms: Build and maintain CI/CD pipelines for data pipelines and Databricks workloads, enabling automated deployments across environments.
- Cost-Efficient & Best-Practice Azure Usage: Apply Azure best practices to optimize performance and cost, including resource sizing, lifecycle management, and cost monitoring.
- Collaboration with BI & Data Teams: Work closely with BI and data teams to support efficient data models and reporting solutions.
- Data Governance & Security Basics: Support data governance requirements such as access control, secure data handling, and basic metadata management.