Sr Data Engineer
Posted
Summary
Senior Data Engineer in Quebec, Canada, designing and maintaining scalable data pipelines, ETL/ELT processes, and data warehouses/lakes. Core stack is SQL, Python, Spark/PySpark, and cloud platforms (AWS, Azure, or GCP), with collaboration across analysts and data scientists.
We are seeking an experienced 10 Years of Data Engineer to design, develop, and maintain scalable data pipelines and data solutions. The ideal candidate should have strong experience in SQL, Python, ETL/ELT, data warehousing, and cloud platforms.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines and ETL/ELT processes.
- Extract, transform, and load data from multiple source systems.
- Develop and optimize SQL queries, stored procedures, and data models.
- Work with structured and unstructured data from various sources.
- Build and maintain data warehouses and data lakes.
- Develop data solutions using Python, SQL, Spark, or PySpark.
- Work with cloud platforms such as AWS, Azure, or GCP.
- Collaborate with Data Analysts, Data Scientists, and business teams to support data requirements.
- Monitor data pipelines and troubleshoot data quality and performance issues.
- Implement data validation, governance, security, and quality standards.
- Automate data workflows and support CI/CD processes.
Required Skills
- Strong experience in 8+Data Engineering.
- Proficiency in SQL and Python.
- Experience with ETL/ELT tools and data pipelines.
- Hands-on experience with Apache Spark / PySpark.
- Experience with AWS, Azure, or GCP.
- Knowledge of data warehousing and data modeling.
- Experience with databases such as SQL Server, PostgreSQL, MySQL, Oracle, or Snowflake.
- Familiarity with Databricks, Kafka, Airflow, or similar technologies is a plus.
- Experience with Git and CI/CD is preferred.
- Strong analytical and problem-solving skills.