Snowflake Data Engineer

Job Summary :

We are seeking a skilled Snowflake Data Engineer to design, develop, and maintain scalable cloud-based data platforms using Snowflake and Azure technologies. The ideal candidate will be responsible for building robust ETL/ELT pipelines, managing Azure Data Lake Storage, implementing event-driven architectures using Azure Functions, and supporting IoT data ingestion. You will collaborate with cross-functional teams to deliver reliable, high-performance data solutions that support analytics and AI/ML initiatives.

Key Responsibilities :

- Design, develop, and maintain scalable ETL/ELT pipelines using Azure Data Factory (ADF) to ingest data from multiple enterprise sources.

- Architect and manage Azure Data Lake Storage (ADLS), including folder structures, access control, lifecycle management, and governance.

- Develop and deploy Azure Functions for event-driven processing, lightweight transformations, and system integrations.

- Build and manage Snowflake objects, tasks, streams, and support DBT model migration across environments using CI/CD pipelines.

- Implement and support Azure IoT Hub and Azure IoT Edge solutions for device-to-cloud data ingestion and telemetry processing.

- Collaborate with engineering and business teams to ensure seamless end-to-end data flow from edge devices to cloud analytics platforms.

- Monitor, troubleshoot, and optimize Azure services and Snowflake environments for performance, scalability, availability, and cost efficiency.

- Define and enforce data platform standards, including metadata management, naming conventions, data quality, and integration best practices.

- Support integration of the data platform with analytics, reporting, and AI/ML solutions.

- Create technical documentation, operational runbooks, and knowledge-sharing materials to support platform maintenance and scalability.

Required Skills :

- Strong hands-on experience with Snowflake.

- Expertise in Azure Data Factory (ADF) and ETL/ELT pipeline development.

- Experience with Azure Functions for event-driven applications.

- Strong knowledge of Azure Data Lake Storage (ADLS).

- Experience with DBT, Snowflake Tasks, Streams, and CI/CD deployment processes.

- Knowledge of Azure IoT Hub and Azure IoT Edge.

- Proficiency in SQL and programming languages such as Python.

- Experience with Azure services, cloud architecture, and data integration patterns.

- Strong understanding of data governance, metadata management, and data quality frameworks.

- Excellent analytical, troubleshooting, and communication skills.

Preferred Skills :

- Experience in the Manufacturing domain.

- Familiarity with Azure DevOps, Git, and CI/CD pipelines.

- Knowledge of analytics and AI/ML data platform integration.

- Experience working with global teams and supporting US business hours.

- Azure or Snowflake certifications are an added advantage.