Senior Data Engineer
Summary
Remote 12-month Inside IR35 contract via staffing firm NES Fircroft. You own a BNA data pipeline's architecture, orchestration and production-readiness in Databricks — SQL, Python/Spark, CI/CD with Azure DevOps, DQ controls, alerting and SFTP activation-file delivery — for a large global oil & gas client.
Senior Data Engineer 12 Months Contract – Remote
Inside IR35
Start date asap
40 hours per week
Must be eligible to work in the UK
Must have: - Advanced SQL, Python/Spark and Databricks data engineering. Workflow orchestration, dependency management, idempotency and scheduled/triggered jobs. CI/CD, Git/Azure DevOps, PR review, unit/integration testing and environment promotion. Production support, DQ controls, alerting, reconciliation and incident diagnosis.
Nice to have: CRM decisioning, customer eligibility/consent and activation experience; Practical Comarch and/or SFMC/SFTP interface experience highly relevant.
Experiene working for large global organisations, preferably within the Oil & Gas
Senior Data Engineer Role Overview:
BNA Principal Data Engineer - Own BNA pipeline architecture, orchestration and production-readiness. Implement/review arbitration, eligibility, suppression, consent, contact-policy and cooldown logic. Own activation datasets/files, manifests, delivery status and SFTP integration. Sequence and approve PRs; enforce end-to-end, regression and production validation. Own production cutover, rerun/recovery, observability, alerting and incident technical response.
Key Skills:
Must Have: Advanced SQL, Python/Spark and Databricks data engineering. Workflow orchestration, dependency management, idempotency and scheduled/triggered jobs. CI/CD, Git/Azure DevOps, PR review, unit/integration testing and environment promotion. Production support, DQ controls, alerting, reconciliation and incident diagnosis
Nice to have: CRM decisioning, customer eligibility/consent and activation experience; Practical comarch and/or SFMC/SFTP interface experience highly relevant.
With over 90 years' combined experience, NES Fircroft (NES) is proud to be the world's leading engineering staffing provider spanning the Oil & Gas, Power & Renewables, Chemicals, Construction & Infrastructure, Life Sciences, Mining andManufacturingsectors worldwide. With more than 80 offices in 45 countries, we are able to provide our clients with the engineering and technical expertise they need, wherever and whenever it is needed. We offer contractors far more than a traditional recruitment service, supporting with everything from securing visas and work permits, to providing market-leading benefits packages and accommodation, ensuring they are safely and compliantly able to support our clients.