Azure Data QA Engineer - Data Lake & ETL Validation
Summary
Designs and validates Azure Data Lake and ETL pipelines using PySpark and SQL to ensure data accuracy and reliability.
confiz in Lahore is seeking a Data Engineer to enhance data transformation processes. This role involves writing PySpark and SQL scripts, designing tests for data validation, and collaborating with development teams on data workflows.
The ideal candidate will have a bachelor's degree, experience in Data Engineering with Azure Data Lake, and proficiency in SQL and PySpark. This dynamic position requires strong interpersonal skills and familiarity with Agile methodologies.