Data Engineer - Python & Snowflake
Description
Project description
We are looking for an experienced Data Engineer with strong hands-on expertise in Python, Snowflake, SQL, and data engineering technologies. You will be responsible for designing, developing, and maintaining scalable data pipelines and solutions supporting enterprise data and analytics platforms.
Responsibilities
- Design, develop, and maintain robust data pipelines and ETL/ELT workflows. Develop Python-based solutions for data ingestion, transformation, validation, and processing. Build and optimize data solutions using Snowflake. Write complex and performance-optimized SQL queries. Develop data pipelines to integrate data from databases, APIs, files, and other enterprise data sources. Perform data transformations and implement business rules according to functional requirements. Design and maintain data models suitable for analytical and reporting requirements. Troubleshoot pipeline failures, data-quality issues, and performance bottlenecks. Optimize Snowflake queries, data structures, and workloads for performance and scalability. Implement appropriate data-quality checks, reconciliation, logging, monitoring, and error handling. Work closely with Data Architects, Business Analysts, Data Scientists, and application teams. Participate in code reviews, testing, deployment, and production support. Follow engineering standards for secure and reliable handling of enterprise data.
SKILLS
Must have
- At least 8 years of experience working within data engineering area, preferably within banking industry. Strong hands-on experience with Python for data engineering and automation. Strong experience with Snowflake data warehouse. Advanced knowledge of SQL, including joins, CTEs, window functions, stored procedures, and query optimization. Good understanding of ETL/ELT architecture and data pipeline development. Experience with data ingestion and transformation of large datasets. Good understanding of data warehousing concepts, dimensional modelling, and data marts. Experience with REST APIs and structured/semi-structured formats such as JSON, CSV, and Parquet. Experience with Git and CI/CD practices. Strong debugging and production troubleshooting skills.
Nice to have
N/A