Data Engineer
Summary
Senior contract data engineer (hybrid in Montreal) who designs, builds, and optimizes scalable data pipelines in Python and PySpark, tunes Spark jobs for performance, and acts as a client-facing technical contact. Core stack: Python, PySpark, SQL, data warehousing, and cloud platforms (AWS/Azure/GCP).
Job Title: Data Engineer (Pyspark & Python)
Location: Montreal, QC (Hybrid)
Type: Contract
Job Overview:
We are seeking a skilled Senior Data Engineer with 5 to 7 years of experience specializing in Python and PySpark. In this role, you will design, build, and optimize robust data pipelines while serving as a primary technical point of contact for clients. The ideal candidate bridges the gap between complex data engineering and strategic client communication.
Key Responsibilities
• Data Pipeline Development: Design, develop, and maintain scalable data processing pipelines using Python and PySpark.
• Client Engagement: Act as the technical face of the team, gathering requirements, presenting data solutions, and managing stakeholder expectations.
• Optimization & Performance: Tune Spark jobs for optimal performance, troubleshooting bottlenecks in large-scale data environments.
• Collaboration: Partner with cross-functional teams, including data scientists, analysts, and project managers, to deliver business-critical data products.
Required Skills & Qualifications
• Experience: 5–7 years of professional experience in data engineering.
• Core Technical Skills: Strong proficiency in Python and hands-on expertise with PySpark (Spark SQL, DataFrames, RDDs).
• Client-Facing Skills: Proven experience in client-facing roles, with excellent verbal and written communication skills to articulate technical concepts to non-technical stakeholders.
• Data Ecosystems: Solid understanding of SQL, data warehousing concepts, and cloud data platforms (AWS, Azure, or GCP).
• Software Practices: Familiarity with Git, CI/CD pipelines, and writing clean, maintainable code.
Preferred Qualifications
• Experience working in an Agile/Scrum environment.
• Knowledge of orchestration tools like Apache Airflow.
Skills
Sign in to read and join the discussion.