DevOps Engineer
Summary
Design and maintain secure CI/CD pipelines for an Azure-based data platform using Databricks, Azure Data Factory, and Informatica IDMC, ensuring audit compliance and DevSecOps controls.
Job Description: DevOps / DevSecOps Engineer
A hands-on DevOps / DevSecOps Engineer to design, build, and operate secure, audit-ready CI/CD and release governance for an Azure-based data platform ecosystem covering Azure Databricks, Azure Data Factory (ADF), and Informatica IDMC. The role owns multi-environment deployment automation (Dev
UAT
Prod), embeds security controls, and ensures every release complies with customer IT security standards and audit expectations.
Experience: • 6+ years overall experience in data platforms and cloud delivery, with at least 3+ years in Azure based data platforms and CI/CD implementation across Databricks, Azure Data Factory (ADF), and Informatica IDMC.
Key Responsibilities (R&R)
• Design, build, and operate Azure DevOps pipelines for Dev
UAT
Prod promotion with approval gates and segregation of duties. • Implement environment aware deployments with parameterisation, secrets management, and rollback capability. • Integrate Databricks Asset Bundles, notebooks, workflows, and jobs into standardized release pipelines. • Enable CI/CD for ADF pipelines and IDMC mappings, ensuring dependency validation and controlled promotion. • Implement rerun, replay, and recovery pipelines to support operational resilience. • Embed DevSecOps controls including RBAC, least privilege access, MFA for privileged roles, and secure secret handling. • Integrate platform alerts and deployment events with ServiceNow and enterprise monitoring tools. • Ensure deployments comply with customers IT Security standards and audit expectations. • Act as DevOps SPOC across data engineering, governance, security, and platform teams.
Mandatory Skills (Must Have)
• CI/CD for Azure Databricks (Notebooks, Jobs, Workflows, Asset Bundles). • Azure Data Factory (ADF) CI/CD and environment promotion. • Informatica IDMC deployment and promotion concepts. • Azure DevOps pipelines and Git branching strategies. • Secrets management using Azure Key Vault. • Entra ID / Azure AD (RBAC, SSO, SCIM concepts). • Strong DevSecOps fundamentals in regulated enterprise environments. • Experience working with multi environment (Dev/UAT/Prod) data platforms.
Good to Have Skills
• Unity Catalog awareness (deployment impact, permissions, lineage dependencies). • ServiceNow integration for alerts and change notifications. • Exposure to Azure Sentinel / security logging integration. • Experience supporting data platform reruns, reconciliation, and DLP operations. • Understanding of metadata driven ingestion and orchestration frameworks. • Experience in large enterprise / public sector / regulated environments.
Behavioural & Delivery Expectations • Strong ownership mindset with accountability for CI/CD and release governance. • Ability to operate under tight go-live timelines while maintaining audit discipline. • Strong collaboration skills across engineering, platform, and security teams.
A hands-on DevOps / DevSecOps Engineer to design, build, and operate secure, audit-ready CI/CD and release governance for an Azure-based data platform ecosystem covering Azure Databricks, Azure Data Factory (ADF), and Informatica IDMC. The role owns multi-environment deployment automation (Dev
UAT
Prod), embeds security controls, and ensures every release complies with customer IT security standards and audit expectations.
Experience: • 6+ years overall experience in data platforms and cloud delivery, with at least 3+ years in Azure based data platforms and CI/CD implementation across Databricks, Azure Data Factory (ADF), and Informatica IDMC.
Key Responsibilities (R&R)
• Design, build, and operate Azure DevOps pipelines for Dev
UAT
Prod promotion with approval gates and segregation of duties. • Implement environment aware deployments with parameterisation, secrets management, and rollback capability. • Integrate Databricks Asset Bundles, notebooks, workflows, and jobs into standardized release pipelines. • Enable CI/CD for ADF pipelines and IDMC mappings, ensuring dependency validation and controlled promotion. • Implement rerun, replay, and recovery pipelines to support operational resilience. • Embed DevSecOps controls including RBAC, least privilege access, MFA for privileged roles, and secure secret handling. • Integrate platform alerts and deployment events with ServiceNow and enterprise monitoring tools. • Ensure deployments comply with customers IT Security standards and audit expectations. • Act as DevOps SPOC across data engineering, governance, security, and platform teams.
Mandatory Skills (Must Have)
• CI/CD for Azure Databricks (Notebooks, Jobs, Workflows, Asset Bundles). • Azure Data Factory (ADF) CI/CD and environment promotion. • Informatica IDMC deployment and promotion concepts. • Azure DevOps pipelines and Git branching strategies. • Secrets management using Azure Key Vault. • Entra ID / Azure AD (RBAC, SSO, SCIM concepts). • Strong DevSecOps fundamentals in regulated enterprise environments. • Experience working with multi environment (Dev/UAT/Prod) data platforms.
Good to Have Skills
• Unity Catalog awareness (deployment impact, permissions, lineage dependencies). • ServiceNow integration for alerts and change notifications. • Exposure to Azure Sentinel / security logging integration. • Experience supporting data platform reruns, reconciliation, and DLP operations. • Understanding of metadata driven ingestion and orchestration frameworks. • Experience in large enterprise / public sector / regulated environments.
Behavioural & Delivery Expectations • Strong ownership mindset with accountability for CI/CD and release governance. • Ability to operate under tight go-live timelines while maintaining audit discipline. • Strong collaboration skills across engineering, platform, and security teams.