Data Engineer
Posted
Summary
Designs, builds, and maintains scalable data platforms and batch/real-time pipelines in Abu Dhabi, delivering analytics, reporting, and AI-ready datasets. Core stack includes Apache NiFi, Kafka, Spark, Flink, and Airflow, with strong Python/Scala/Java and SQL skills.
The Data Engineer will design, build, and maintain scalable data platforms and pipelines. The role involves working with modern big data technologies to deliver reliable, high-quality data solutions. The candidate will collaborate with various teams to support analytics, reporting, and AI-ready datasets.
Responsibilities
- Design and develop large-scale data ingestion, storage, and processing solutions.
- Build and maintain batch and real-time data pipelines.
- Develop scalable and high-performance data platforms handling structured and unstructured data.
- Implement data models, change data capture (CDC), and data integration solutions.
- Ensure data quality, governance, observability, and operational excellence.
Qualifications
- Experience with Apache NiFi, Kafka, Spark, Flink, and Airflow
- Strong knowledge of Data Engineering, ETL/ELT, Data Modeling, OLAP, and CDC
- Proficiency in Python, Scala, or Java
- Advanced SQL skills
- Experience with MinIO/S3, Kafka, Avro, Parquet, and ORC
Desired Candidate Profile