Senior Snowflake Data Engineer
Summary
Design, deploy, and optimize Snowflake data warehouses and infrastructure using Terraform, ensuring secure, high-performance analytics for cross-functional teams.
Must have: Snowflake Infrastructure
Good To Have: Terraform, Databricks
Job Description
- Configure, deploy, and maintain Snowflake accounts, virtual warehouses, databases, and schemas.
- Use Terraform to provision and manage Snowflake resources (databases, warehouses, roles, users) and associated cloud infrastructure, ensuring consistency and repeatability through Infrastructure as Code.
- Monitor warehouse performance, query performance, and resource utilization; troubleshoot issues to ensure optimal system performance.
- Implement and manage access controls, including role-based access control (RBAC), secure data sharing, and data governance policies to protect sensitive data.
- Manage Snowflake releases, features, and account-level configurations; evaluate and enable new capabilities as needed.
- Provide technical support to Snowflake users, including query troubleshooting, performance tuning, and issue resolution.
- Optimize warehouse sizing, auto-suspend/resume settings, and query design for performance and cost efficiency.
- Monitor and manage auto-scaling of virtual warehouses to ensure efficient resource allocation.
- Implement and enforce security policies, including RBAC, masking policies, row-level security, and encryption mechanisms.
- Develop and maintain backup, failover, and disaster recovery strategies using features like Time Travel and Fail-safe to ensure data integrity and availability.
- Collaborate with data engineers to integrate Snowflake with external data sources, data lakes, and ETL/ELT pipelines.
- Monitor and manage platform costs, including credit usage, storage costs, and optimizing workloads to control expenses.
- Collaborate with cross-functional teams (data engineers, data scientists, analysts, and business stakeholders) to understand requirements and deliver scalable data solutions.