Databricks Architect – Informatica, Spark & PySpark
Summary
Designs and implements scalable data platforms using Databricks, Spark, PySpark, and Delta Lake, leading ETL migrations from Informatica to cloud-based solutions.
Job Description:
Databricks Architect (with Informatica)-Databricks, Informatica PowerCenter and/or IICS/IDMC, Spark, PySpark, SQL, Delta Lake, Unity Catalog.
Brampton, ON - Hybrid (4 Days WFO)
Role Descriptions:
Design and implement scalable data platforms using Databricks Lakehouse| Delta Lake| Spark| and PySpark.Architect batch and real-time data pipelines on Azure/AWS/GCP.Lead ETL modernization and migration from Informatica PowerCenter/IICS/IDMC to Databricks.Define data governance| security| performance optimization| and best practices.Collaborate with business and technical teams to deliver enterprise data solutions.
Essential Skills:
- Required Skills:-Strong expertise in Databricks| Spark| PySpark| SQL| Delta Lake| Unity Catalog.
- Hands-on experience with Informatica PowerCenter and/or IICS/IDMC.
- Experience in data warehousing| data modeling| and cloud platforms (Azure preferred).
- Knowledge of CI/CD| Git| and Agile methodologies.
- Preferred Skills:-Databricks and Cloud certifications.
- Experience with Snowflake| Azure Synapse| Kafka| or Data Governance tools.