Production-Scale Data Engineer (PySpark) - Dubai
Summary
Designs, builds, and maintains scalable PySpark-based data pipelines for production, handling ingestion, transformation, validation, and deployment with Python, SQL/NoSQL, and CI/CD tools.
Black Pearl Consult in Dubai is seeking an experienced Data Engineer (PySpark) to design, build, optimize and maintain scalable data pipelines for production environments. You will work across ingestion, transformation, validation and deployment to ensure reliability and performance.
You'll apply PySpark, Python, SQL/NoSQL, and CI/CD with GitHub Actions, Airflow and Jenkins to deliver production-grade data solutions.