Data Engineer (open to remote candidates)
Description
We are partnering with a leading enterprise organization seeking an experienced Data Engineer to support a strategic data transformation programme. This role will focus on designing scalable data models, developing robust data pipelines and supporting business analytics through a modern data platform environment.
Responsibilities
* Design and maintain enterprise-scale dimensional data models
* Develop Spark/PySpark data pipelines for batch and incremental processing
* Build and optimize data solutions within Databricks and Microsoft Fabric
* Design scalable Lakehouse and Warehouse architectures
* Perform complex SQL development, transformation and validation
* Implement data quality monitoring and automated testing frameworks
* Maintain documentation, metadata management and lineage tracking
* Optimize platform performance and support cost-efficiency initiatives * Collaborate with business and technical stakeholders to deliver analytics solutions
Requirements
* 5+ years of Data Engineering experience
* Strong expertise in dimensional data modelling
* Hands-on experience with Databricks
* Strong Microsoft Fabric experience * Advanced SQL skills
* Strong Spark/PySpark development experience
* Experience with Delta Lake and Lakehouse architectures
* Knowledge of CI/CD and DevOps practices
* Strong problem-solving and stakeholder communication skills
Preferred
* Experience working in enterprise-scale environments
* Exposure to analytics and reporting platforms
* Experience improving performance and platform optimization
