Data Engineer | Dicetek | Abu Dhabi
Posted Updated
Description
Dicetek in Abu Dhabi is seeking an accomplished Data Engineer to design, build, and scale cloud data pipelines and warehousing architectures. You will work on ETL/ELT workflows, real-time data processing streams, and scalable storage using Databricks and Azure data technologies.
The ideal candidate brings PySpark, Python, SQL, DeltaLake, and enterprise data modeling expertise, with on-site collaboration with data scientists and analytics teams to support AI/ML workloads.
Design, develop, test, and maintain scalable ETL and ELT data pipelines for enterprise data platforms. Build robust data integration and transformation solutions utilizing Azure Data Factory, Databricks, and Azure Data Lake. Develop advanced data models, data warehouses, and real-time data processing solutions using Kafka and PySpark. Implement comprehensive data quality, validation, security governance, and performance optimization practices. Support AI/ML and advanced analytics workloads by collaborating directly with Data Scientists and business stakeholders. Implement CI/CD and MLOps practices for automated, reliable, and version-controlled data deployments. Process, clean, and transform complex datasets using Python, SQL, and DeltaLake architectures. Bachelor’s or Master’s degree in Computer Science, Engineering, Data Engineering, or a related technical field. Extensive hands-on expertise with Databricks, Azure Data Factory, Azure Data Lake, and DeltaLake. Deep proficiency in PySpark, Python, and advanced SQL programming for data transformation. Solid practical experience with real-time data processing frameworks such as Apache Kafka.Skills
Sign in to read and join the discussion.