Data Engineer
Summary
Design and build scalable data pipelines and real-time streaming solutions using Spark, Kafka, and cloud platforms to transform raw data into actionable insights for enterprise clients.
About the Role
Teamware Solutions is hiring an experienced Data Engineer for one of the leading Digital Infrastructure and Cloud Services organizations in the UAE.
We are looking for a highly skilled data engineering professional who is passionate about building scalable, high-performance data platforms and real-time streaming solutions. In this role, you will design and optimize enterprise-grade data pipelines, develop modern data architectures, and enable organizations to transform data into actionable insights. You will work with cutting-edge big data technologies, cloud platforms, and containerised environments while contributing to mission-critical digital transformation initiatives.
If you thrive in a fast-paced environment and enjoy solving complex data engineering challenges, we'd love to hear from you.
What You’ll Do
- Design, develop, and maintain scalable ETL/ELT data pipelines for batch and real-time data processing using Spark.
- Build and manage real-time streaming data pipelines using Kafka and Spark Streaming/Flink.
- Deploy, manage, and optimise applications on OpenShift and Kubernetes platforms.
- Design and develop high-performance data workflows on Cloudera Hadoop and cloud-based platforms.
- Implement robust data ingestion frameworks using Kafka and NiFi.
- Design, develop, and optimise enterprise data warehouse architectures and data models.
- Automate data engineering workflows using Apache Airflow and Oozie.
- Implement and maintain CI/CD pipelines for data engineering workloads.
- Collaborate with DevOps teams to automate build, testing, deployment, and monitoring processes.
- Ensure data quality, governance, security, and compliance across enterprise data platforms.
- Troubleshoot and optimise data processing performance, scalability, and reliability.
- Work closely with cross-functional teams to deliver high-quality data solutions that support business objectives.
What We’re Looking For
- 10+ years of experience in Data Engineering, Big Data, or related disciplines.
- Strong hands‑on expertise in Apache Spark for large-scale data processing.
- Experience building real-time streaming solutions using Kafka, Spark Streaming or Apache Flink.
- Strong knowledge of ETL/ELT architecture and data pipeline development.
- Experience with Cloudera Hadoop ecosystem and cloud-based data platforms.
- Hands‑on experience with Kafka, Apache NiFi, Airflow, and Oozie.
- Good understanding of OpenShift and Kubernetes container platforms.
- Experience designing scalable data warehouses and data models.
- Strong knowledge of CI/CD practices for data engineering workloads.
- Familiarity with DevOps methodologies and automation tools.
- Understanding of data governance, data quality, security and enterprise data management best practices.
- Excellent analytical, problem‑solving and communication skills.
Why Join Teamware Solutions?
- Opportunity to work with one of the leading Digital Infrastructure and Cloud Services organizations in the Middle East.
- Be part of large-scale enterprise digital transformation initiatives.
- Work with cutting‑edge Big Data, Cloud, Kubernetes and Streaming technologies.
- Collaborative, innovation-driven and high‑performing engineering culture.
- Excellent career growth opportunities with enterprise‑scale projects.
- Competitive compensation and long‑term career prospects.
We are an equal opportunity employer and welcome candidates from diverse backgrounds.