Senior Big Data Engineer
Summary
Senior Data Engineer (8–15 years) hired on Teamware's payroll to work with a leading digital infrastructure & technology client in Dubai. Day to day: design scalable ETL/ELT and real-time streaming pipelines using Hadoop/Cloudera, Spark, Kafka, Flink, Airflow, and NiFi, deployed across AWS/Azure/GCP and OpenShift/Kubernetes.
Client: Leading Digital Infrastructure & Technology Company
Payroll: Teamware Human Resource Solutions LLC
About the Role
Teamware Human Resource Solutions LLC is looking for an experienced Senior Data Engineer with 8–15 years of experience in Big Data and Data Engineering.
The ideal candidate should have strong hands‑on experience in scalable data pipelines, ETL/ELT, real‑time streaming, Hadoop/Cloudera, Spark, Kafka, and cloud platforms. Experience across AWS, Azure, GCP, OpenShift/Kubernetes, along with exposure to AI/ML, NLP, and Statistical Modeling, will be highly valued.
- Design, develop, and maintain scalable ETL/ELT data pipelines for batch and real‑time processing.
- Build and manage real‑time streaming pipelines using Apache Kafka, Spark Streaming, and/or Flink.
- Develop high-performance data workflows across Cloudera/Hadoop and Cloud platforms.
- Build robust data ingestion frameworks using Kafka and Apache NiFi.
- Design and optimize data warehouse architectures and data models.
- Automate data workflows using Airflow and Oozie.
- Deploy and manage data applications on OpenShift/Kubernetes.
- Implement CI/CD pipelines and collaborate with DevOps teams for automated deployment.
- Drive data migration and integration across on‑premise and cloud environments.
- Ensure strong data quality, governance, security, performance, and reliability.
- 8–15 years of experience in Data Engineering / Big Data
- Strong hands‑on experience in Hadoop / Cloudera
- Strong experience with Apache Spark & Spark Streaming
- Hands‑on experience with Apache Kafka
- Strong ETL/ELT and Data Pipeline development experience
- Experience with Hive & HBase
- Experience with AWS / Azure / GCP
- Experience with Flink
- Experience with Airflow / Oozie
- Experience with NiFi
- Experience with OpenShift / Kubernetes
- Strong experience in Data Migration & Data Integration
- Understanding of Data Quality, Governance & Security
Good to Have
- Experience with large‑scale enterprise data platforms
- Strong technical leadership and stakeholder management capabilities
Qualifications
- Bachelor’s degree in Computer Science, Engineering, Information Technology, or a related discipline with relevant professional experience.
Work with Leading Digital Infrastructure & Technology Company on large‑scale digital and data transformation initiatives in Dubai.
Opportunity to work on enterprise‑grade data platforms in an international environment.