Databricks Architect: Real-Time Data & Spark Pipelines
Summary
Designs and optimizes real-time ETL pipelines on Databricks and Spark, integrating data via APIs and CI/CD workflows for large-scale processing.
A technology solutions company in Canada is seeking an experienced Databricks Architect to build and optimize ETL pipelines on AWS or Azure. The ideal candidate will have strong expertise in Databricks, Spark, SQL, and Python. Responsibilities include implementing CI/CD pipelines, integrating data using APIs, and leading data engineering initiatives. The role offers a chance to work on large-scale data processing projects within a collaborative environment.