Senior Big Data Engineer
Summary
Senior data engineer (8–15 yrs) on Teamware's payroll, placed with a digital infrastructure client in Dubai, building scalable ETL/ELT and real-time streaming pipelines using Hadoop/Cloudera, Spark, Kafka, and Flink across AWS/Azure/GCP, deployed via OpenShift/Kubernetes with Airflow-orchestrated workflows and CI/CD.
WE'RE HIRING | Senior Data Engineer – Big Data & Cloud
Location: Dubai, UAE
Client: Leading Digital Infrastructure & Technology Company
Payroll: Teamware Human Resource Solutions LLC
Employment Type: Full-Time
Experience: 8–15 Years
Domain: Big Data | Data Engineering | Cloud | Real-Time Streaming | Analytics
About the Role
Teamware Human Resource Solutions LLC is looking for an experienced Senior Data Engineer with 8–15 years of experience in Big Data and Data Engineering.
The ideal candidate should have strong hands-on experience in scalable data pipelines, ETL/ELT, real-time streaming, Hadoop/Cloudera, Spark, Kafka, and cloud platforms. Experience across AWS, Azure, GCP, OpenShift/Kubernetes, along with exposure to AI/ML, NLP, and Statistical Modeling, will be highly valued.
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT data pipelines for batch and real-time processing.
- Build and manage real-time streaming pipelines using Apache Kafka, Spark Streaming, and/or Flink.
- Develop high-performance data workflows across Cloudera/Hadoop and Cloud platforms.
- Build robust data ingestion frameworks using Kafka and Apache NiFi.
- Design and optimize data warehouse architectures and data models.
- Automate data workflows using Airflow and Oozie.
- Deploy and manage data applications on OpenShift/Kubernetes.
- Implement CI/CD pipelines and collaborate with DevOps teams for automated deployment.
- Drive data migration and integration across on-premise and cloud environments.
- Ensure strong data quality, governance, security, performance, and reliability.
Must-Have Skills
- 8–15 years of experience in Data Engineering / Big Data
- Strong hands-on experience in Hadoop / Cloudera
- Strong experience with Apache Spark & Spark Streaming
- Hands-on experience with Apache Kafka
- Strong ETL/ELT and Data Pipeline development experience
- Experience with Hive & HBase
- Experience with AWS / Azure / GCP
- Experience with Flink
- Experience with Airflow / Oozie
- Experience with NiFi
- Experience with OpenShift / Kubernetes
- Strong experience in Data Migration & Data Integration
- Understanding of Data Quality, Governance & Security
Good to Have
- Exposure to AI / Machine Learning
- NLP experience
- Statistical Modeling
- Experience with large-scale enterprise data platforms
- Strong technical leadership and stakeholder management capabilities
Qualifications
Bachelor's degree in Computer Science, Engineering, Information Technology, or a related discipline with relevant professional experience.
Why Join
- Work with Leading Digital Infrastructure & Technology Company on large-scale digital and data transformation initiatives in Dubai.
- Work across modern Big Data, Cloud & Real-Time Streaming technologies.
- Opportunity to work on enterprise-grade data platforms in an international environment.