Data Engineer
Description
Job Overview
We are looking for skilled Data Engineers with hands-on experience in designing, developing, and maintaining scalable data pipelines, ETL processes, and data engineering solutions.
The ideal candidate should have strong knowledge of Python, SQL, PySpark, cloud platforms, and modern data engineering technologies.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines and ETL/ELT workflows.
- Develop data processing solutions using Python, PySpark, and Apache Spark.
- Write optimized SQL queries and perform complex data transformations.
- Work with large datasets, data warehouses, and distributed computing environments.
- Build and manage data integration and processing solutions.
- Work with cloud-based data engineering platforms such as AWS and Azure.
- Develop and maintain data workflows using Databricks and related technologies.
- Ensure data quality, accuracy, performance, and reliability.
- Collaborate with data analysts, data scientists, architects, and development teams.
Required Technical Skills
- Python Programming
- Advanced SQL
- PySpark / Apache Spark
- ETL / ELT Development
- Data Warehousing
- Data Pipeline Development
- Data Integration
- AWS / Azure Cloud
- Databricks
Good to Have Skills
- AWS Glue, S3, Redshift
- Azure Data Factory
- Delta Lake
- Apache Airflow
- Hadoop / Big Data Technologies
- Snowflake
- CI/CD and Git
Eligibility
- 2 to 7 years of relevant experience in Data Engineering.
- Strong hands-on experience in Python, SQL, and data processing.
- Experience developing ETL pipelines and working with large datasets.
- Knowledge of cloud-based data engineering solutions.
- Good analytical, troubleshooting, and problem-solving skills.
Interested candidates with relevant Data Engineering experience are encouraged to apply.