Senior Data Engineer: Data Mesh & Cloud Automation
Summary
Designs and builds scalable data pipelines and reusable components in a Data Mesh architecture using Spark, Hadoop, Hive, Python, AWS services, and DevOps/IaC tools.
Zup Innovation seeks a data-focused engineer in Dubai to design architectures, implement scalable data pipelines and reusable components (connectors, APIs, SDKs, CLIs) within a Data Mesh context. You will test automation, adapt solutions from user feedback, and push for high-quality innovation across products.
Ideal candidates bring expertise in Spark, Hadoop, Hive, Python, and AWS services (S3/Lambda/SQS/DynamoDB/API Gateway) with SQL/NoSQL experience and DevOps/IaC experience using Terraform