Data Engineer - Databricks
Summary
Build and optimize Databricks-based data pipelines and cloud data platform migrations for a UAE organization’s final transformation phase.
Location: UAE (Fully Onsite) - Khalifa City
Contract: Initial 3 Months
Rate: Up to €420 per day
We're supporting a leading organisation in the UAE that is entering the final phase of a major cloud data platform transformation. They are seeking an experienced Data Engineer to join the team on a contract basis and help deliver critical migration and platform optimisation activities.
This is a hands‑on engineering role focused on modernising legacy data solutions, building scalable data pipelines, and supporting the completion of a Databricks‑based data platform. You'll work alongside an established Agile engineering team, taking ownership of technical deliverables and contributing to the successful transition of the platform into operational support.
Key Responsibilities
- Develop and maintain scalable data pipelines and ingestion frameworks.
- Migrate legacy data ingestion processes to modern Databricks solutions.
- Refactor existing data models to align with engineering best practices.
- Optimise Databricks environments, including cluster performance and governance.
- Support the decommissioning of legacy data platform components.
- Participate in testing, validation, deployments, code reviews, and continuous improvement initiatives.
- Produce high‑quality technical documentation and contribute to operational readiness.
- Work closely with the engineering team within an Agile delivery environment.
Required Skills & Experience
- Strong commercial experience with Databricks (5+ years preferred).
- Hands‑on experience with:
- Auto Loader
- Cluster optimisation and policy management
- Experience with Azure Data Factory (ADF).
- Strong Python and SQL development skills.
- Solid Git/source control experience.
- Experience with CI/CD pipelines and DevOps practices.
- Experience designing and delivering scalable data engineering solutions.
- Strong understanding of testing, validation, and production deployment processes.
About Korn Ferry
Korn Ferry unleashes potential in people, teams, and organizations. We work with our clients to design optimal organization structures, roles, and responsibilities. We help them hire the right people and advise them on how to reward and motivate their workforce while developing professionals as they navigate and advance their careers. To learn more, please visit Korn Ferry at www.Kornferry.com