Snowflake Lead
Posted Updated
Summary
Lead-level Snowflake data engineering role: design and build data pipelines into Snowflake, implement ETL/transformations with tools like ADF and Matillion, optimize warehouse and query performance, and set up CI/CD via Azure DevOps. Core stack: Snowflake, SnowSQL, Snowpipe, SQL, Python, and Azure cloud services.
Roles and Responsibilities :
- Design and implement data pipelines for ingesting data from various sources (databases, cloud storage, streaming platforms) into Snowflake.
- Deep understanding of Snowflake's architecture, features, and best practices.
- Implement data transformations using ETL tools like Matillion or ADF and quality checks within the pipelines.
- Experience in various Ingestion methods in Snowflake (Copy, Snowpipe, Dynamic tables, streams and tasks)
- Deep understanding about EDW Concepts, CDC Mechanisms, Dimensional Modeling concepts.
- Optimize and maintain Snowflake data warehouse and query performance.
- Integrate Snowflake with various data sources and third-party tools.
- Implementing CI/CD pipelines for Snowflake using Azure DevOps.
- Proficiency in SQL and Python or other scripting languages.
- Familiarity with Azure Cloud Platform Services like ADLS, ADF etc.
- Knowledge of data security best practices and relevant regulations
Job Requirements :
- 8-15 years of experience in IT Services & Consulting industry with expertise in cloud technologies such as Microsoft Azure Data Factory.
- Strong proficiency in SnowSQL programming language for querying large datasets.
- Experience with SnowPipe architecture for real-time data processing and analytics workloads.