freehire launches on Product Hunt on 26 August.

Follow →

Senior Data Engineer (m/f/d)

Summary

Designs and builds scalable data pipelines and cloud-based data platforms using Spark, Kafka, and Delta Lake to power analytics and ML workloads.

Senior Data Engineer


  • 12 month extendable contract
  • Abu Dhabi | Office Based

I am seeking an experienced Senior Data Engineer to join a growing data and analytics team responsible for building scalable, secure, and high-performance data platforms. The successful candidate will design, develop, and optimize modern data solutions that support advanced analytics, business intelligence, and machine learning initiatives.




This role requires expertise in large-scale data engineering, cloud technologies, and modern data architectures, with a strong focus on reliability, performance, security, and data governance.




Key Responsibilities

  • Design, develop, and maintain scalable data pipelines and ETL/ELT processes to ingest, transform, and process large-scale datasets.
  • Build and optimize data processing frameworks using technologies such as Spark, Delta Lake, Kafka, and other modern big data platforms.
  • Develop and maintain data models, schemas, data lakes, lakehouses, and data warehouses that support analytics and reporting requirements.
  • Implement data quality, validation, monitoring, and observability frameworks to ensure data accuracy and reliability.
  • Design and support real-time and batch data processing solutions using streaming technologies and distributed systems.
  • Ensure compliance with security, privacy, access control, and regulatory requirements for sensitive data.
  • Collaborate closely with data scientists, analysts, architects, and business stakeholders to deliver high-value data products and services.
  • Manage and enhance distributed data platforms to ensure scalability, availability, and performance.
  • Contribute to data governance, master data management, metadata management, and data catalog initiatives.
  • Stay current with emerging technologies, industry best practices, and innovations in cloud and data engineering.

Required Qualifications

  • Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
  • Minimum 5 years of experience designing, building, and operating enterprise-scale data platforms and pipelines.
  • Strong proficiency in SQL and Python.
  • Hands-on experience with Apache Spark, distributed data processing frameworks, workflow orchestration tools, and messaging platforms such as Kafka.
  • Experience with cloud-based data solutions on Azure, AWS, or Google Cloud Platform.
  • Strong knowledge of data warehousing, data lakes, lakehouse architectures, and data modeling methodologies.
  • Experience working with containerization and orchestration technologies such as Docker and Kubernetes.
  • Understanding of data governance, data quality, security, and privacy best practices.
  • Strong analytical, problem-solving, and communication skills.



#LI-MW1

See also