Lead Software Engineer

Job Title: Backend/API Developer - Data-Databricks Unity Catalog

Location: PCS CA~TORONTO

Years of Experience: 5-7 Years

Job Summary: We are seeking a skilled Backend/API Developer with expertise in Data-Databricks Unity Catalog, focusing on Data Integrity and Governance. The ideal candidate will have a strong background in Data Governance, Data Catalog, Data Lineage, and Data Quality, and will play a crucial role in ensuring the integrity and accessibility of our data assets.

Responsibilities:

• Design, develop, and maintain backend services and APIs for the Data-Databricks Unity Catalog.
• Implement data governance frameworks to ensure data integrity and compliance.
• Collaborate with data engineers and analysts to establish data lineage and quality metrics.
• Develop and maintain a comprehensive data catalog to enhance data discoverability.
• Monitor and troubleshoot data quality issues, implementing solutions as necessary.
• Participate in code reviews and contribute to best practices in software development.
• Work closely with cross-functional teams to gather requirements and deliver solutions that meet business needs.

Mandatory Skills:

• Proficiency in Azure cloud services.
• Strong experience with Databricks and Unity Catalog.
• Solid understanding of data governance principles and practices.
• Experience with data lineage and data quality frameworks.
• Proficient in backend development languages (e.g., Python, Java, or Scala).

Preferred Skills:

• Familiarity with data cataloging tools and technologies.
• Experience with ETL processes and data integration.
• Knowledge of data modeling and database design.
• Understanding of data privacy regulations and compliance standards.

Qualifications:

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• 5-7 years of relevant experience in backend/API development.
• Strong analytical and problem-solving skills.
• Excellent communication and collaboration abilities.