Senior Data Engineer

Open 35d posting dated 2 weeks ago

We are looking for a Senior Data Engineer to lead the migration of existing Apache Airflow workflows to Azure Data Factory (ADF) and strengthen the data layer behind our reporting solutions. The role is hands-on and focused on building reliable pipelines, solid data models, and ensuring smooth end-to-end data flow—from source systems all the way to reports. Experience with Power BI environments is highly valued.

What you’ll do:

  • Lead the migration of Airflow DAGs and data workflows to Azure Data Factory (ADF)

  • Build and maintain data pipelines, transformations, and data models supporting reporting and analytics

  • Troubleshoot and support end-to-end data flows: ingestion → processing → datasets → reports

  • Collaborate closely with Power BI developers and business stakeholders to align data outputs with reporting needs

  • Take ownership of production reliability: monitoring, incident resolution, and continuous improvement of pipelines

Requirements (must have):

  • Strong hands-on experience in data engineering (pipelines, transformations, modelling)

  • Very good SQL skills and practical data modelling experience

  • Proven experience with Azure Data Factory (ADF) in production use cases

  • Hands-on experience with Apache Airflow (DAGs, dependencies, troubleshooting) and readiness to drive migrations

  • Scripting experience in Python (or similar) for automation and data processing

  • Good understanding of Power BI datasets and reporting environments

  • Ability to troubleshoot independently and own solutions end to end

  • Strong communication skills and comfort working with both technical and business stakeholders

Nice to have:

  • Experience with Azure data platform components (e.g., ADLS, Azure SQL, Synapse, Databricks)

  • CI/CD for data pipelines and Infrastructure as Code

  • Data quality frameworks, monitoring/alerting, and operational best practices

  • Performance optimisation in ETL/ELT workflows

  • Experience working in Agile teams