Senior Data Engineer (Databricks)
Posted
Summary
Senior Data Engineer to build and scale an Azure Databricks data platform: evolving Bronze/Silver/Gold Medallion layers, refactoring legacy Python parallelization into idiomatic Spark DataFrames/SQL, and implementing row-level security. Remote within Spain; core stack is Azure Databricks, Delta Lake, Spark, and Python.
At MZtech, we turn complex, raw data into strategic, AI-ready assets. We are looking for a Senior Data Engineer to build, scale, and evolve a high-impact Azure Databricks platform.
What will you do?
- Evolve the Medallion Architecture: Design, extend, and stabilize Bronze, Silver, and Gold layers on Azure Databricks, with a strong focus on unlocking value from unstructured data assets.
- Refactor for Scale & Performance: Eliminate technical debt and optimize data pipelines for speed and reliability—migrating legacy Python parallelization to idiomatic Spark DataFrames, Spark SQL, and UDFs.
- Shape Technical Strategy: Partner directly with stakeholders to translate complex business requirements into long-term architectural decisions.
Must-Haves
- Databricks & Spark Mastery: Deep, production-grade experience with Azure Databricks, Delta Lake, Medallion architecture, and writing idiomatic Spark for high-volume workloads.
- Data Governance: Practical experience implementing Row-Level Security (RLS) and identity-based access controls.
- Pragmatic Ownership: A solution-oriented senior mindset, you thrive in ambiguity, navigate evolving requirements calmly, and take proactive ownership of outcomes.
- Platform Enablement & Communication: Strong empathy for internal users paired with clear, concise communication in business English.
Nice-to-Haves
- Hybrid Background: Hands-on experience bridging both Data Engineering and Platform Engineering.
- Unstructured & AI-Ready Data: Experience building ingestion pipelines for unstructured data (e.g., OCR, PDF/email parsing) and understanding how data feeds downstream AI/RAG workloads.
- Infrastructure as Code: Working familiarity with IaC tools like Terraform.
Why MZtech?
- High-Impact Ownership: Join a specialized consultancy where your architectural decisions directly shape how enterprise teams leverage data and AI.
- Remote-First Flexibility: Work remotely from anywhere in Spain, with all travel and expenses covered for in-person team meetups. (Note: Confirm if Spanish residency is required here as in the previous role).
- Stability & Time Off: Permanent contract (contrato indefinido) plus 22 days of paid vacation.
- Continuous Growth: €300 annual learning budget for courses, books, or certifications of your choice, plus a home-office setup budget.
Skills
Sign in to read and join the discussion.