Data Engineer APIs And Spark
Summary
Data Engineer on CDAI's Data Technology team builds and maintains data APIs and scalable pipelines using Python, SQL, Airflow, and Spark on AWS, with data quality checks and monitoring. Hybrid Toronto role (four office days weekly) collaborating with data scientists and analytic engineers on hospitality tech.
Develop data APIs and Spark solutions for CDAI, where hospitality innovation meets technology. This hybrid role requires four office days weekly.
CDAI seeks a Data Engineer for its Data Technology team and modern technology stack. You will collaborate with internal and external stakeholders, Data Scientists, and Analytic Engineers. Your focus includes scalable pipelines, integrations, data quality, and consumer-focused innovation.
Key Responsibilities:
- Develop and maintain data APIs across varied sources
- Create scalable pipelines with Python, SQL, Airflow, and Spark
- Implement data quality checks and monitoring
- Resolve data issues proactively across pipelines
- Prototype technologies enabling data-driven consumer experiences
Requirements:
- Three to five years of relevant Data Engineering experience
- Strong programming ability in Python and SQL
- Hands-on experience with AWS, Lambda, Airflow, and Spark
- Preferred experience with Iceberg, EMR, and Snowflake
- Strong communication and collaborative working approach
Use API development, Spark, Python, and data quality expertise to advance CDAI’s digital hospitality products.