Data Platform Engineer

Role: AWS Lakehouse Platform Engineer

Location: Abu Dhabi
Employment Type: Full-time

Overview

We are seeking a Lakehouse Platform Engineer to manage, optimize, and evolve the entire Lakehouse technology stack, ensuring platform reliability, scalability, and compliance with governance standards. This role is critical for maintaining the backbone of our data ecosystem and enabling self-service capabilities for data teams.

Key Responsibilities

• Platform Management & Optimization
  • Manage and maintain Lakehouse components:
  • Storage: S3 bucket configurations, lifecycle policies, storage optimization.
  • Compute: AWS Glue job management, optimization, DPU allocation.
  • Catalog: AWS Glue Data Catalog and Iceberg table registry.
  • Semantic Layer: Deploy and integrate with our semantic layer.
  • Governance: Deploy, configure, and upgrade OpenMetadata.
  • Quality: Maintain Soda Core infrastructure and integration.
  • Apply Iceberg best practices for table optimization and maintenance.
  • Implement automated table maintenance processes.
• Self-Service & Automation
  • Deploy self-service tooling for Data Factory squads.
  • Implement automated lineage capture from Glue jobs.
  • Configure audit logging (CloudTrail, S3 access logs).
• Disaster Recovery & Reliability
  • Design and implement Disaster Recovery (DR) scenarios including failover, backup management, and runbooks.
  • Execute annual DR tests for the entire data landscape.
  • Ensure all critical platform components are monitored, with alerting and active follow-up.
• Migration & Decommissioning
  • Execute decommissioning roadmap.
• Collaboration
  • Work closely with platform engineers and architects to ensure alignment on optimization and tooling.
  • Partner with operational teams for monitoring and alerting.

Required Skills & Experience

• Technical Expertise
  • Strong experience managing Lakehouse platforms on AWS.
  • Proficiency in AWS services: S3, Glue, CloudTrail, Athena.
  • Hands‑on experience with Apache Iceberg, OpenMetadata, and Soda Core.
  • Knowledge of disaster recovery planning and execution.
• Tools & Technologies
  • Infrastructure automation using Terraform and Git.
  • Familiarity with Kafka (MSK) and OpenSearch.
  • Able to identify ways to automate their work / repetitive tasks.
• Soft Skills
  • Strong problem‑solving and troubleshooting skills.
  • Ability to work cross‑functionally and manage complex platform operations.
  • Ability to work in a fast‑paced environment and deliver aggressive migration targets.
  • Strong collaboration and communication skills.
  • Work with Jira and agile way of working.

Preferred Qualifications

• 8+ years in data platform engineering or related roles.
• Experience in financial services or banking domain is a plus.