Data Engineer (Databricks & Microsoft Fabric)
Posted Updated
We are partnering with a leading enterprise organization seeking an experienced Data Engineer to support a strategic data transformation programme.
This role will focus on designing scalable data models, developing robust data pipelines and supporting business analytics through a modern data platform environment.
Responsibilities
- Design and maintain enterprise-scale dimensional data models
- Develop Spark/PySpark data pipelines for batch and incremental processing
- Build and optimize data solutions within Databricks and Microsoft Fabric
- Design scalable Lakehouse and Warehouse architectures
- Perform complex SQL development, transformation and validation
- Implement data quality monitoring and automated testing frameworks
- Maintain documentation, metadata management and lineage tracking
- Optimize platform performance and support cost-efficiency initiatives
- Collaborate with business and technical stakeholders to deliver analytics solutions
Requirements
- 5+ years of Data Engineering experience
- Strong expertise in dimensional data modelling
- Hands-on experience with Databricks
- Strong Microsoft Fabric experience
- Advanced SQL skills
- Strong Spark/PySpark development experience
- Experience with Delta Lake and Lakehouse architectures
- Knowledge of CI/CD and DevOps practices
- Strong problem-solving and stakeholder communication skills
Preferred
- Experience working in enterprise-scale environments
- Exposure to analytics and reporting platforms
- Experience improving performance and platform optimization