Data Engineer (4-5 Years)
Summary
Build and maintain scalable ETL/ELT pipelines using Python, Snowflake, Databricks, and Azure Data Factory to process and transform data for analytics and reporting.
Data Engineer
Location: DHA Phase-8, Lahore
Responsibilities
- Design, build, and maintain efficient and scalable ETL/ELT data pipelines using tools like Azure Data Factory or Apache Airflow.
- Develop, test, and deploy Python-based data processing solutions.
- Work with Snowflake, Databricks and other data warehousing technologies to support data analytics and reporting needs.
- Write complex and optimized SQL queries for data transformation and extraction.
- Ensure data quality, accuracy, and compliance with internal and external standards.
- Collaborate with data engineers, analysts, and stakeholders to define and implement data workflows.
- Utilize version control (Git) and CI/CD pipelines for code deployment and process automation.
- (Optional/Preferred) Support backend services using Django and task queues with Celery.
Qualifications
- Python
- SQL
- Snowflake
- Databricks
- Azure (or AWS)
- ETL/ELT
- ADF / Apache Airflow
- Data Warehousing
- Git
- CI/CD
- Django (preferred)
- Celery (preferred)