Data Architect (databricks/data modelling)
Summary
Design and implement enterprise-grade data platforms on Azure for an insurance company, focusing on scalable modeling, governance, and analytics using Synapse, Databricks, Power BI, and Azure ML.
- BCom or BSc degree or equivalent in IT | Business qualification
- Minimum 7 years of experience in enterprise-level data architecture, solution design and modeling of insurance-based data technologies
- Proven ability to lead large-scale data platform implementations across hybrid and cloud environments
- Expertise in designing scalable, secure and cost-effective data architectures in the cloud aligned with business and regulatory requirements
- Extensive hands-on experience with:
- Azure SQL Database, Azure Synapse Analytics, Azure Cosmos DB
- Azure Blob Storage, Azure Data Lake Storage
- Azure Data Factory, Azure Stream Analytics
- Azure Analysis Services, Azure Machine Learning
- Strong understanding of Azure-native data integration, transformation and analytical capabilities
- Proficient in conceptual, logical and physical data modeling using tools like Visio, Azure Synapse, Power BI and Databricks
- Experience designing semantic models for Power BI and Azure Analysis Services to support enterprise-wise reporting
- Skilled in dimensional modeling, star/snowflake schemas and metadata management
- Implemented data quality frameworks and observability practices using Azure Monitor, Purview and custom telemetry tools working closely with the Data Architect
- Experience with anomaly detection, data validation rules and lineage tracking to ensure trust and transparency
- Defined and monitored data SLAs and KPIs across business-critical pipelines
- Experience implementing and integrating Master Data Management solutions to ensure consistency of key business entities across systems
- Defined governance models and stewardship processes for managing golden records, resolving data conflicts, data retention working closely with the Data Centre of Excellence
- Worked with Microsoft Purview and other MDM tools to support data cataloging, lineage and reference data management
- Proficiency in Power BI, Power Apps, Power Automate, and Microsoft 365 tools
- Experience designing interactive dashboards and automating business workflows
- Familiarity with Azure Security Center, Azure Monitor, Azure Policy and Azure Backup
- Experience implementing security best practices and compliance frameworks (POPIA, GDPR)
- Hands-on experience with Microsoft Purview and/or other data governance tools
- Experience with Azure DevOps, CI/CD pipelines, Terraform, and Machine Learning Ops
- Ability to manage infrastructure and deployments using automated tooling and IaC principles
- Demonstrated success working with enterprise solutions architect, data engineers, analysts, developers, and business stakeholders.
- Experience participating in architecture forums, steering committees, and governance bodies.
- 5+ years domain knowledge in Insurance (Short Term / Life / Microinsurance / Health Insurance)
- Experience in aligning data strategies with regulatory and operational needs in the insurance sector
Duties & Responsibilities
Architect Scalable Data Platforms:
- Design and implement enterprise-grade data architectures using Microsoft Azure technologies including Azure SQL, Synapse, Cosmos DB, Data Lake, Databricks, PySpark Notebooks and Dataverse
- Ensure platforms are secure, resilient and optimized for performance and cost
- Establish scalable data modeling practices, including conceptual, logical and physical models aligned with business domains
- Drive the transformation of legacy systems into cloud-native solutions from a data technology perspective
- Promote the adoption of modern data services and analytics tools across the organization
- Oversee migration strategies, including schema conversions, data mapping and validation processes
- Define and enforce standards for data sourcing, structuring, validation, storage and security, working closely with the Data Centre of Excellence
- Ensure compliance with POPIA, GDPR and internal governance frameworks
- Assist the business data architect with implementation of metadata management, data cataloging and sensitive data tracking initiatives
- Support discoverability and lineage tracking
- Integrate tools such as Power BI, Azure Analysis Services and Azure Machine Learning to support decision-making, enabling the Data Teams in the Planning Units of the business
- Collaborate with business units to deliver actionable insights through data visualization and predictive modeling
- Support semantic modeling and KPI definitions to ensure consistent reporting across data teams
- Provide architectural guidance for .NET-based applications and data-driven solutions working with the Enterprise Solutions Architect
- Enable seamless integration across Microsoft 365, Power Platform, Dynamics 365 and SharePoint / Teams
- Ensure data contracts are well-defined for interoperability and reuse
- Implement CI/CD pipelines, infrastructure-as-code (Terraform) and automated data workflows using Azure Data Factory and Power Automate
- Promote DevOps culture and tooling across data engineering teams
- Monitor and optimize ETL pipelines, ensuring observability, reliability and scalability
- Work closely with enterprise solutions architect, data architect, data engineers, developers, analysts and business teams to align technology with strategic goals
- Represent the business in architecture forums, steering committees and cloud governance bodies from a data technologies perspective
- Facilitate cross-functional data governance and stewardship initiatives
- Guide junior architects and engineers in best practices and certification pathways
- Foster a culture of continuous learning and innovation within the data technology space
- Encourage hands-on experience with data modeling tools, ETL frameworks and Azure services
- Define and implement data quality frameworks to monitor accuracy, completeness, consistency and timeliness across data assets working closely with the Data Architect
- Implement observability tools such as Azure Log Analytics, Application Insights, Purview to track data lineage, usage patterns and health
Please consider your application as unsuccessful if you have not received a response within 14 days of submitting your application.