Azure Platform Engineer - Data bricks Administration

Exciting Opportunity Alert! HTC Global Services is hiring Azure Platform Engineer - Databricks Administration for a 1-year extendable contract in Abu Dhabi, UAE (Onsite).

HTC Global Services - a leading CMM level 5 global provider of innovative IT and Business Process Services and Solutions since 1990 with headquarters in Troy, Michigan, USA.

Key Responsibilities

• Administer and manage Azure Databricks workspaces across multiple environments.
• Configure, manage, and optimize Databricks clusters, cluster policies, and job workloads.
• Manage Databricks platform security, including user provisioning, RBAC, service principals, secrets management, and governance controls.
• Implement and administer Unity Catalog for data governance and access management.
• Monitor and troubleshoot Databricks jobs, workflows, clusters, and platform performance issues.
• Perform root cause analysis and implement corrective actions for platform incidents.
• Design and implement backup, disaster recovery, and high-availability solutions.
• Automate infrastructure provisioning and platform management using Terraform and Infrastructure as Code (IaC) practices.
• Manage Azure services including ADLS Gen2, Event Hub, Cosmos DB, Azure Functions, Logic Apps, API Management, and App Services.
• Configure and maintain monitoring, logging, and alerting using Azure Monitor, Log Analytics, and Application Insights.
• Support and maintain CI/CD pipelines using Azure DevOps and Jenkins.
• Develop automation scripts using Python and Shell scripting to improve operational efficiency.
• Manage containerized applications using Docker and Azure Kubernetes Service (AKS).
• Monitor and troubleshoot Azure infrastructure components including VMs, storage, networking, memory, and CPU utilization.
• Collaborate with development and data engineering teams to optimize platform performance and reliability.
• Participate in Agile ceremonies and contribute to continuous improvement initiatives.