Senior Data Engineer: Spark, Airflow & Lakehouse
Summary
Build and maintain end-to-end data pipelines using Spark and Airflow, containerize code with Docker/Kubernetes, and enforce data quality in a lakehouse architecture.
TalentHue - IT & Corporate Recruitment is seeking a Data Engineer in Lahore, Pakistan. This role involves building and operating end-to-end data pipelines, performing data ingestion and transformation across the lakehouse stack, deploying through CI/CD.
The ideal candidate will have over 6 years of data engineering experience, with significant skills in Spark and Apache Airflow. Responsibilities include containerizing code for deployment on Docker/Kubernetes and implementing data quality checks.