Data Engineer
Summary
Hands-on data engineer designing, building, and supporting enterprise-scale data pipelines and the Enterprise Data Lake on Azure (Data Factory, Databricks, Synapse, Spark) using Python and SQL, collaborating with business and tech teams across Canada and Asia. Requires 5-7 years of data engineering experience and excellent English.
This is an excellent opportunity for a hands-on engineer who enjoys working with modern cloud data technologies and building enterprise-scale data platforms in a collaborative global environment.
Excellent written and spoken English is required, as this role regularly collaborates with business and technology teams in Canada and across Asia.
Key Responsibilities
- Design, develop, and support data pipelines and integrations across multiple source systems.
- Build ETL/ELT solutions using Azure Data Factory, Databricks, Synapse, Spark, Python, and SQL.
- Develop and maintain data ingestion, transformation, and data quality processes.
- Conduct proof-of-concepts (POCs) for new technologies and integration patterns.
- Monitor data pipelines and platform performance, troubleshoot issues, and optimize processing efficiency.
- Maintain and support the Enterprise Data Lake (EDL) to ensure platform stability and reliability.
- Investigate and resolve production incidents and support change requests.
- Develop and maintain technical documentation and operational support materials.
- Perform unit testing, system integration testing, and deployment validation.
- Collaborate with business, technology, and data teams across Asia and Canada.
- Support the design and delivery of business-aligned data products, ensuring datasets are reusable, well-defined, and fit for analytics and reporting needs.
- Participate in Agile delivery ceremonies and support end-to-end project delivery.
Required Qualifications
- Bachelor’s degree in Computer Science, Engineering, Information Systems, or a related discipline.
- 5–7 years of experience in Data Engineering, Software Engineering, Platform Engineering, or related technical roles.
- Strong hands-on experience with Azure Data Platform technologies, including:
- Azure Data Factory
- Azure Databricks
- Azure Synapse Analytics
- Azure Data Lake Storage (ADLS)
- Spark / PySpark
- Python
- SQL
- Event Hubs
- Experience with database development and management (e.g., Azure SQL, Cosmos DB).
- Experience building and supporting cloud-based data solutions and enterprise data platforms.
- Experience with Change Data Capture (CDC) technologies (e.g., Debezium) and data integration solutions.
- Strong analytical, troubleshooting, and problem-solving skills.
- Experience working in Agile delivery teams.
Preferred Qualifications
- Experience in financial services, wealth management, insurance, or asset management industries.
- Knowledge of data governance, metadata management, and data quality practices.
- Understanding of data product concepts, including data domains, reusable data assets, data ownership, data contracts, and business-facing data consumption.
- Experience with AI, Business Intelligence (BI), and/or Generative AI solutions.
Communication Requirements
- Excellent written and spoken English is mandatory.
- Ability to communicate effectively with stakeholders in Canada and across Asia.
- Strong collaboration and stakeholder management skills.
- Comfortable working in a global, multicultural, and distributed team environment.
When you join our team:
- We’ll empower you to learn and grow the career you want.
- We’ll recognize and support you in a flexible environment where well-being and inclusion are more than just words.
- As part of our global team, we’ll support you in shaping the future you want to see.
Skills
- Agile
- AI
- Analytics
- Azure
- Azure Data Factory
- Azure Synapse
- Business Intelligence
- Cloud
- Cosmos Db
- Data Engineering
- Data Governance
- Data Ingestion
- Data Lake
- Data Pipelines
- Data Quality
- Databricks
- Debezium
- ELT
- ETL
- Generative AI
- Integration Testing
- Metadata Management
- PySpark
- Python
- Spark
- SQL
- Stakeholder Management
- System Integration
- Unit Testing
Sign in to read and join the discussion.