Senior Data Engineer — Real-Time Data Platform Lead
Summary
Senior Data Engineer at Systems Limited in Punjab, Pakistan, designing and maintaining scalable data pipelines. Day-to-day work spans real-time streaming (Kafka, Flink, Spark Streaming), batch processing (Spark/PySpark), containerization, orchestration with Airflow or Azure Data Factory, lakehouse storage, data quality with Great Expectations, and mentoring a team.
Systems Limited is seeking a Senior Data Engineer with 6+ years of hands-on experience to design and maintain scalable data pipelines. You will work with real-time streaming (Kafka, Flink, Spark Streaming) and batch processing (Spark PySpark), while containerizing applications and orchestrating with Airflow or Azure Data Factory.
You will mentor a team, implement lakehouse storage formats, and ensure data quality with Great Expectations in an agile setting.