Data & Software Engineer
Summary
Designs and builds data pipelines, cloud infrastructure, and automated workflows using Azure, Databricks, Python, and SQL for large-scale data processing.
- Works largely independently within defined projects/work streams and is checked on end results.
- Has an executional role in design and development projects or acts as an expert tester who designs test scripts and provides overall project guidance and planning support.
- Advises internally on solving functional and technical problems regarding the assigned applications and Infrastructure.
Requirements:
- Strong experience with Azure cloud services, including ADLS, Azure Storage, Azure SQL Database, and Azure Synapse Analytics
- Hands‑on expertise with Databricks for large‑scale data processing and lakehouse style pipelines.
- Advanced proficiency in SQL for complex transformations, modelling, and performance tuning.
- Strong programming ability in Python for data pipelines, automation, and integration.
- Experience implementing CI/CD workflows and working with containerized environments