Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

Valletta.Software | AI-Care

NewBe an early applicant

Senior Data Engineer (remote EU only) — Azure Databricks + dbt

Posted
Discussion

Summary

Remote (EU residents only) senior data engineer building batch and API data pipelines on Azure Databricks (Spark, Delta Lake) with dbt, for a long-term project with a Danish pharmaceutical/biotech client. Focus on data quality, schema enforcement, monitoring/alerting, governance, and CI/CD/MLOps.

We are looking for a Senior Data Engineer to join a long-term project with a Danish client in the pharmaceutical/biotech domain.

Location: Remote, but EU residency is mandatory (we cannot consider candidates outside the European Union).

What you'll do:

  • Implement batch and API-based data ingestion.
  • Apply schema enforcement and handle schema drift; run data quality checks at ingestion.
  • Work hands-on with dbt for pipeline observability and data governance.
  • Monitor job failures, data freshness, and pipeline health against SLA targets.
  • Set up alerts, logging, and retry strategies for production pipelines.
  • Work within a controlled Dev/Test/Prod environment: access control, audit trails, pipeline documentation, traceability to requirements.
  • Contribute to CI/CD and MLOps/AI pipelines on Databricks.

Must-haves:

  • Strong hands-on experience with Azure Databricks: Spark, Delta Lake.
  • Schema enforcement and schema-drift handling.
  • Data quality checks at ingestion.
  • Batch and API-based data ingestion.
  • Strong hands-on experience with dbt.
  • Monitoring job failures, data freshness, and pipeline health.
  • Alerts, logging, and retry strategies.
  • Access control models, audit trails, lineage, traceability.
  • Data contracts, pipeline documentation, controlled environments (Dev/Test/Prod).
  • EU residency.

Nice-to-have:

  • CI/CD & DevOps for Data (Git-based development, CI/CD pipelines for data workflows).
  • AI/MLOps — MLOps/AI pipelines on Databricks.
  • Exposure to regulatory domains (GxP, clinical trials, pharmacovigilance).
  • Dimensional modeling: star schema, OBT, curated marts.
  • Tabular Editor, Power BI.
  • Pharma/biotech industry experience.

This is a senior, independent role: the ideal candidate is comfortable taking ownership with minimal oversight and has a flexible, self-driven mindset.

A Global, Thriving Team

Join remotely 100+ specialists from 20+ countries, united by a passion for outstanding IT solutions.

Diverse projects:

Fintech, MedTech, AI/ML, e-commerce, and more. Switch teams or industries to broaden your skills.

Support at Every Step Client interview prep: We train you to succeed + give actionable feedback.

Strategic stability:

Well-structured processes, strong management, and long- term vision.

Core values:

Honesty, flexibility, innovation, and a people-first approach.

Skills

What Senior Data Engineering jobs ask for — and how much of it you have →
Apply

See also

Data Engineering jobs by country — openings, pay and top skills →