Databricks Security Engineer
Summary
Builds and maintains a secure, auditable data access framework in a Databricks Lakehouse: configuring Unity Catalog permissions, masking/filtering sensitive data, automating controls with Terraform, and supporting audits and compliance. Core tech: Databricks, Unity Catalog, Terraform, SQL, Python, AWS IAM.
This position is listed on behalf of a partner company, which manages all applications and next steps. Our partner is looking for a Databricks Security Engineer based in the United States.
We are looking for a skilled Databricks Security Engineer to help build and maintain a secure, scalable, and auditable data access framework within a modern cloud-based Lakehouse environment. In this hands-on role, you will implement access controls, manage data permissions, and safeguard sensitive information across enterprise data platforms. Working closely with data engineers, platform engineers, and workspace administrators, you will ensure that security policies are consistently applied and aligned with organizational governance standards. You will leverage technologies such as Unity Catalog, Terraform, SQL, and Python to automate security configurations and strengthen access management practices. Your work will also contribute to audit readiness, data classification, and regulatory compliance while enabling engineering teams to work securely and efficiently. This remote opportunity is ideal for a detail-oriented technical professional who enjoys solving data security challenges and building reliable, well-governed data environments.
Accountabilities
- Implement data access controls: Support the implementation and ongoing management of access control frameworks within the Databricks Lakehouse environment, ensuring that data access is secure, consistent, and aligned with established policies.
- Manage Unity Catalog permissions: Configure and maintain data structures, permissions, grants, and tagging within Unity Catalog to support appropriate access management and data governance.
- Protect sensitive information: Maintain security controls for sensitive data, including data filtering, masking, and other access restrictions that help prevent unauthorized exposure.
- Automate security configurations: Manage access controls as code using Terraform and related infrastructure-as-code tools to improve consistency, traceability, and repeatability across environments.
- Coordinate platform security: Collaborate with workspace administrators, data engineers, and platform engineering teams to maintain consistent access controls and resolve configuration issues across the data ecosystem.
- Support auditing and reporting: Assist with security audits, access reviews, reporting, and documentation to maintain transparency, demonstrate compliance, and support internal governance requirements.
- Monitor data access activity: Use Databricks system tables, audit logs, and access reporting capabilities to help review permissions, investigate access-related issues, and identify potential security gaps.
- Guide engineering teams: Provide day-to-day technical guidance on data tagging, permission management, and access requests, helping engineers follow established security and approval procedures.
- Strengthen data governance: Support data classification, tagging, and governance initiatives to ensure that data assets are appropriately categorized and protected throughout their lifecycle.
- Contribute to continuous improvement: Identify opportunities to improve access management processes, security automation, documentation, and operational practices as the data security function evolves.
Requirements
- Education and experience: A bachelor's degree in software engineering, data engineering, computer science, or a related technical field, with at least five years of relevant experience; alternatively, a master's degree in a relevant discipline with at least three years of related experience.
- Access control fundamentals: Familiarity with identity and access management principles, including role-based access control (RBAC) and attribute-based access control (ABAC).
- Databricks expertise: Experience working with Databricks and Unity Catalog, including familiarity with system tables, audit logs, permissions, and access reporting.
- Programming and querying skills: Working knowledge of SQL and Python to support data platform operations, access analysis, and security-related tasks.
- Infrastructure as code: Practical experience with Terraform or similar infrastructure-as-code tools for managing and automating access controls and platform configurations.
- Cloud identity and access management: Familiarity with AWS IAM concepts, including groups, roles, policies, and service principals, and an understanding of how cloud permissions interact with data platform security.
- Data governance and classification: Experience supporting data classification, data tagging, governance processes, or related data protection initiatives.
- Compliance awareness: Familiarity with the technical or operational aspects of compliance frameworks and requirements such as SOC 2, HIPAA, or GDPR is preferred.
- Security-minded approach: Strong attention to detail and the ability to apply access policies carefully, follow established governance procedures, and work within formal approval processes.
- Collaboration and communication: Ability to work effectively with data engineers, administrators, platform teams, and other technical stakeholders while explaining access requirements and security practices clearly.
- Problem-solving skills: A methodical, proactive approach to troubleshooting permissions, identifying access discrepancies, and improving security processes.
- Remote work readiness: Ability to work independently in a remote environment while maintaining effective communication and collaboration with distributed teams.
Benefits
- Competitive annual salary: Base salary range of $113,900–$170,900 USD, depending on experience, education, skills, job responsibilities, and prevailing market conditions.
- Potential additional compensation: Eligibility for overtime, shift differentials, or discretionary bonuses, depending on the position and applicable arrangements.
- Performance-based rewards: Annual bonus opportunities designed to recognize individual contributions and overall organizational performance.
- Health insurance: Access to healthcare coverage and other eligible employee health benefits.
- Life and disability insurance: Coverage options designed to support employees and their families.
- Retirement savings: Access to an employer-sponsored savings plan.
- Paid time off: Company-paid holidays and paid time off for vacation and personal needs.
- Remote work flexibility: The opportunity to work remotely from within the United States, with a preferred location in Falls Church, Virginia.
- Technical growth: Opportunities to deepen expertise in cloud security, Databricks, infrastructure automation, data governance, and enterprise access management.
- Collaborative environment: The opportunity to work alongside data engineering, platform, and security professionals on complex technical challenges.
- Equal employment opportunity: A commitment to fair employment practices and a workplace that values diverse backgrounds, skills, and perspectives.
- Relocation: Relocation assistance is not available for this position.
- Travel requirements: No travel is expected for this role.
- Security clearance: No security clearance is required at the start of employment.
Skills
As published by lever
Resume/CV, Full name, Email, Phone, Current location, Current company