Senior Data Engineer

In this role, you will collaborate closely with one of our esteemed clients—a globally recognized leader in their industry, distinguished by their commitment to excellence, innovation, and delivering exceptional value. As a trusted IT consulting partner, Dautom is supporting their strategic initiatives by connecting them with exceptional talent to drive business growth and transformation.

Role Name : Senior Data Engineer

Job Location : Abu Dhabi, UAE

• Minimum 10 years in Data Engineering Domain
• Experience in UAE or Middle East is desirable
• Education : B.Tech/BE
• Strong hands-on experience with Cloudera Data Platform (CDP) and modern Data Lakehouse architectures.
• Expertise in SQL, Python, and data pipeline development for large-scale data integration and transformation.
• Experience with Talend, Apache Spark, Kafka, and Airflow for batch, real-time, and streaming data processing.
• Strong knowledge of Trino, Delta Lake/Iceberg, and Delta Sharing for data virtualization, storage, and sharing.
• Experience in data modelling, including Dimensional, Data Vault, and Lakehouse modelling techniques, Medallion Architecture and Data Mesh principles.
• Hands-on experience with OpenMetadata, Apache Ranger, metadata management, data lineage, and data governance frameworks.
• Experience in API integration, data services, and enterprise data product development.
• Proficiency in Git, CI/CD, DevOps practices, and performance optimization

• Machine Learning Data Engineering and Feature Stores.
• Power BI Semantic Models and Analytics Enablement.
• Docker and Kubernetes.
• Strong experience working with Linux-based operating systems (RHEL, CentOS, Rocky Linux, Ubuntu
• Cloud platforms (Azure, AWS, or GCP)

• Design, build, and manage enterprise data products and datasets in accordance with data architecture, governance, security, and data-sharing standards.
• Develop and maintain scalable data ingestion, integration, and transformation pipelines using batch, real-time, and streaming processing patterns.
• Engineer and optimize data solutions across the enterprise data platform, ensuring performance, reliability, scalability, and reusability.
• Design and maintain logical and physical data models to support analytics, AI, and business consumption.
• Implement data quality, validation, monitoring, and observability frameworks to ensure trusted and reliable data assets.
• Administer and support platform services, including orchestration, metadata management, data cataloging, lineage, and access controls.
• Develop APIs, data virtualization, and data-sharing services to enable secure and efficient access to enterprise data.
• Monitor, troubleshoot, and optimize platform operations, data pipelines, and resource utilization to ensure service availability and operational excellence.
• Maintain technical documentation, standards, and operational runbooks to support governance, compliance, and knowledge transfer.

• Comply with enterprise data management, information security, governance, and software development policies and procedures.
• Participate in audits, compliance reviews, and assessments related to data platform operations and data governance.
• Support the preparation of operational, service performance, and data quality reports, as required.
• Identify and elevate data quality, security, compliance, and operational risks, recommending corrective actions where appropriate.