Senior Data Engineer - Databricks Data Migration
Summary
Senior Data Engineer at EPAM in Abu Dhabi (onsite) leading production-grade Databricks data pipelines using PySpark and SQL, migrating transformation logic from a legacy platform while ensuring data quality. Also optimizes performance with partitioning and Delta Lake, reviews code, mentors juniors, and works in CI/CD and Agile delivery.
EPAM Systems in Abu Dhabi, UAE, is seeking a Senior Data Engineer to join onsite. You will lead production-grade data pipelines on Databricks using PySpark and SQL, migrating transformation logic from a legacy platform, and ensuring data quality across the data platform.
You will optimize performance through partitioning and Delta Lake, design validation processes, review code, mentor junior engineers, and collaborate in CI/CD and Agile delivery.
Skills
Sign in to read and join the discussion.