Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

Andersen Lab

Data Engineer (Azure Databricks) in the EU

Posted Updated

Description

Andersen Lab is seeking a Data Engineer (Azure Databricks) to enhance a cloud-based data platform and deliver scalable data solutions for drug development. You will work on data ingestion, governance, and MLOps within a controlled Dev/Test/Prod environment, applying dbt and Spark Delta Lake techniques.

The role requires 4+ years in data engineering, strong SQL skills, and English at an upper-intermediate level, with flexible remote or hybrid work options across EU locations.

Implement batch and API-based data ingestion from multiple source systems. Apply schema enforcement and handle schema drift; run data quality checks at ingestion. Work hands-on with dbt for pipeline observability and data governance tasks. Monitor job failures, data freshness, and pipeline health against SLA-based delivery targets. Set up alerts, logging, and retry strategies for production pipelines. Work within a controlled Dev/Test/Prod environment: access control, audit trails, pipeline documentation, traceability to requirements. Contribute to CI/CD and MLOps/AI pipelines on Databricks where the project needs it. Commercial experience in Data Engineering for 4+ years. Strong hands-on experience with Azure Databricks, including Spark and Delta Lake. Experience building and maintaining multi-layer data pipelines following the Landing → Raw → Enriched → Curated architecture. Experience with schema enforcement and schema-drift handling. Ability to implement data quality checks at ingestion. Experience orchestrating pipelines using Databricks Jobs / Workflows, including dependencies, retries, alerts, and failure handling. Experience with both batch and API-based data ingestion. Strong hands-on experience with dbt. Ability to monitor job failures, data freshness, and overall pipeline health. Experience delivering data in line with defined SLAs. Experience implementing alerting, logging, and retry strategies. Experience designing and maintaining access control models. Understanding of audit trails, data lineage, and end-to-end traceability. Experience with logging and evidence generation for audit and compliance purposes. Understanding of segregation of duties. Experience defining and maintaining data contracts. Ability to create and maintain clear pipeline documentation. Experience working across controlled Dev, Test, and Prod environments. Ability to ensure traceability between requirements and implemented data solutions. Level of English – from Upper-Intermediate and above. Remote or hybrid work option Mentoring program Annual bonus up to 1000 EUR/month Private health insurance Sports compensation Professional training portal Referral program

Skills

Apply

See also

Data Engineering jobs by country — openings, pay and top skills →