Senior Data Engineer
Posted Updated
Description
Astra Tech Group in Abu Dhabi is seeking a Senior Data Engineer to own the financial data warehouse, real-time platform and data governance initiatives. You will design scalable data models and pipelines across banking and risk domains.
You will collaborate with risk, treasury and BI teams, implement SSOT, ensure batch and streaming parity, and lead data quality initiatives while applying Hive, Spark, Flink and Kafka in production environments.
Design and develop the Financial Data Warehouse covering ODS, DWD, DWS and ADS layers. Build scalable data models across users, transactions, repayments and risk domains. Design and develop real-time data pipelines using Kafka and Flink. Support real-time risk features, transaction monitoring and operational dashboards. Ensure consistency between batch and real-time data through unified architectures. Establish a Single Source of Truth (SSOT) for key business KPIs. Build data governance, metadata and data quality frameworks. Implement automated monitoring and quality checks across batch and streaming pipelines. 5+ years of experience in Data Engineering / Big Data development. Hands-on with Hive, Spark and Flink. Understanding of DWH architecture and ODS/DWD/DWS/ADS layering. Production experience with Kafka, Flink or similar streaming tech. Experience with state management, exactly-once processing and late-arriving data. Experience in ETL, data modelling and optimisation. Experience building data governance and data quality frameworks. Mandatory: banking/fintech/payments/credit or financial risk experience. Knowledge of loan origination, repayments, delinquency and risk data.Skills
Sign in to read and join the discussion.