Databricks Platform Engineer
Posted Updated
Description
Job Role: Databricks Platform Engineer (Terraform / AWS / GitLab CI/CD)
Location: Remote (USA/Canada)
Type: FTE/C2C
Year of Experience: 10+ years
Domain Experience (Required)
Property & Casualty, Life & Annuity, Workers Compensation, Retirement, Reinsurance, Broker-Dealer Insurance, MGAs, and MGUs.
Note: We won’t be considering candidates with Healthcare Insurance experience for this role.
Role summary
This is a hands-on engineer role covering Databricks infrastructure-as-code, deployment on AWS, and CI/CD integration with GitLab. You’ll work closely with platform engineering.
Key responsibilities
- Deploy and manage Databricks on AWS using Terraform
- Build and maintain Terraform code for Databricks resources: workspaces, clusters, jobs, permissions, and Unity Catalog
- Set up GitLab CI/CD pipelines that deploy infrastructure and Databricks assets
- Configure secure connections between GitLab, Databricks and AWS
- Work with platform engineers on infrastructure standards and integrations
Must-have skills
- Terraform with the Databricks provider
- Databricks deployment on AWS
- GitLab CI/CD integration with Databricks
- Core AWS services: IAM, VPC, S3
Skills
Sign in to read and join the discussion.