Snowflake Data Engineer

12 hr. ago 8 hr. ago

Role & Responsibilities:

1. Design and implement data pipelines for ingesting data from various sources (databases, cloud storage, streaming platforms) into Snowflake.

2. Deep understanding of Snowflake's architecture, features, and best practices.

3. Implement data transformations using ETL tools like Matillion or ADF and quality checks within the pipelines.

4. Experience in various Ingestion methods in Snowflake (Copy, Snowpipe, Dynamic tables, streams and tasks)

5. Deep understanding about EDW Concepts, CDC Mechanisms, Dimensional Modeling concepts

6. Optimize and maintain Snowflake data warehouse and query performance.

7. Integrate Snowflake with various data sources and third-party tools.

8. Experience in implementing CI/CD pipelines for Snowflake using Azure DevOps.

9. Proficiency in SQL and Python or other scripting languages.

10. Experience in Data Migration to Cloud.

11. Familiarity with Azure Cloud Platform Services like ADLS, ADF etc.

12. Knowledge of data security best practices and relevant regulations.

Skills:

1. Snowflake, Python / Pyspark,

2. ETL Preferred Skills: Azure Data Factory(ADF), Matillion, Data Warehousing / Dimensional Modeling Concepts

Skills