Data Engineer
Posted 47
views
Summary
Design, build, and maintain data pipelines and ETL/ELT processes, writing optimized SQL and Python solutions, and managing data warehouses and lakes on a cloud platform. Core stack includes Spark/PySpark, Airflow orchestration, cloud (AWS/Azure/GCP), and relational databases, with a focus on data quality, security, and governance.
- Design, develop, and maintain efficient data pipelines.
- Extract, transform, and load data from multiple sources using ETL/ELT processes.
- Write and optimize SQL queries for data processing and analysis.
- Develop data processing solutions using Python.
- Build and maintain data warehouses and data lakes.
- Ensure data accuracy, quality, and consistency.
- Monitor, troubleshoot, and improve data pipeline performance.
- Work with cloud platforms to manage and process large datasets.
- Collaborate with data analysts, data scientists, and other teams.
- Maintain data security and follow data governance standards.
Required Skills
- Strong knowledge of SQL and database concepts.
- Good programming skills in Python.
- Hands‑on experience with ETL/ELT processes.
- Understanding of Data Warehousing and Data Modeling.
- Knowledge of Apache Spark / PySpark.
- Experience with any one cloud platform: AWS, Azure, or GCP.
- Knowledge of data pipeline orchestration tools like Apache Airflow.
- Understanding of databases such as MySQL, PostgreSQL, or SQL Server.
- Knowledge of Git and version control.
- Good analytical, problem‑solving, and communication skills.
Skills
Sign in to read and join the discussion.