Cloud Infrastructure, DevOps & Databricks Platform Engineer

Job Description: Cloud Infrastructure, DevOps & Databricks Platform Engineer

Experience: 3–5 years

Role Overview

We are looking for an experienced Cloud Infrastructure & DevOps Engineer to design, automate, secure, and manage Azure cloud infrastructure and the Azure Databricks platform. The role involves infrastructure automation, CI/CD, platform administration, governance, monitoring, and production operations.

Key Responsibilities

• Azure Infrastructure: Provision and manage Azure resources, VNets, subnets, NSGs, Private Endpoints, Private DNS, Azure Firewall, Key Vault, and identity/access controls.
• Infrastructure as Code: Develop and maintain reusable Terraform modules for automated, consistent infrastructure provisioning.
• DevOps & CI/CD: Build and manage Azure DevOps YAML pipelines and GitHub Actions for infrastructure and application deployments across Dev, UAT, and Prod.
• Databricks Platform Administration: Administer Azure Databricks workspaces, workspace access, compute resources, cluster policies, SQL warehouses, Unity Catalog, metastore configuration, service principals, and access connectors.
• Databricks DevOps: Automate deployment of notebooks, workflows/jobs, and related configurations across environments using CI/CD and Databricks Asset Bundles.
• Security & Governance: Implement RBAC, least-privilege access, private connectivity, secrets management, security policies, vulnerability remediation, and compliance controls.
• Monitoring & Operations: Configure Azure Monitor, Log Analytics, alerts, troubleshoot infrastructure and pipeline failures, and support production operations.
• Disaster Recovery & FinOps: Support backup and recovery strategies, DR planning and testing, high availability, resource optimization, and cloud cost management.

Required Technical Skills

• Strong hands-on experience with Microsoft Azure infrastructure and networking.
• Proficiency in Terraform and reusable Infrastructure as Code modules.
• Experience with Azure DevOps, YAML pipelines, GitHub Actions, and Git-based workflows.
• Hands-on experience with Azure Databricks administration, Unity Catalog, access controls, compute management, and workspace governance.
• Understanding of Python, Bash, or PowerShell scripting and automation.
• Knowledge of cloud security, monitoring, troubleshooting, and production support.

Good to Have

• Experience with Azure Kubernetes Service (AKS) and Kubernetes.
• Experience with Databricks Asset Bundles, REST APIs, and automated workspace deployments.
• Exposure to Azure Data Factory, data platform migrations, and DataOps.
• Experience with disaster recovery, business continuity, and FinOps practices.

Candidate Profile

Strong troubleshooting and automation skills, a security-first mindset, and the ability to collaborate with data engineering, security, and application teams to deliver reliable, governed, production-ready cloud and data platforms.