Walk-in || AWS Databricks Platform Administrator - A
Description
Role & Responsibilities:
- Administer Databricks accounts, workspaces, users, groups, permissions, clusters, jobs, and SQL warehouses.
- Manage Unity Catalog, metastores, catalogs, schemas, and data access controls.
- Provision and maintain AWS Databricks environments using Terraform, CloudFormation, or equivalent IaC tools.
- Integrate Databricks with AWS services, including IAM, S3, EC2, VPC, KMS, CloudWatch, and CloudTrail.
- Implement cloud security, access management, encryption, private connectivity, and networking controls.
- Automate platform deployments and operational tasks using CI/CD pipelines and scripting.
- Monitor platform health, troubleshoot production issues, perform root-cause analysis, and ensure platform availability.
- Optimize cluster performance, resource utilization, and cloud costs.
- Handle incident, problem, change, and service request management for production environments.
- Maintain operational documentation, runbooks, backup procedures, and disaster recovery plans.
Preferred Candidate Profile:
- 6-12 years of experience in cloud infrastructure, data platforms, DevOps, or production administration.
- Strong hands-on experience in Databricks administration with demonstrable expertise in AWS-hosted deployments.
- Proficiency in AWS services, including IAM, S3, EC2, VPC, KMS, CloudWatch, and Secrets Manager.
- Experience with Unity Catalog, workspace administration, cluster policies, jobs, and compute management.
- Hands-on experience with Terraform, CloudFormation, or equivalent infrastructure automation tools.
- Experience with CI/CD tools such as Jenkins, GitHub Actions, GitLab CI, or AWS CodePipeline.
- Proficiency in Python, Bash, or PowerShell scripting.
- Working knowledge of Apache Spark, Delta Lake, SQL, cloud security, monitoring, and production support.
- Databricks and AWS certifications are preferred but not mandatory.
