Data_Engineer_Python_Snowflake_Azure
Posted Updated
Summary
Data engineer building and maintaining data ingestion pipelines with Python, Azure, Snowflake and an orchestrator (e.g. Airflow/Prefect/Dagster), integrating data from APIs, databases and file transfers with incremental loads and data-quality checks. Must work US Pacific (PST) hours from Hyderabad.
Role & responsibilities
- Build and maintain ingestion pipelines using Python, a workflow orchestrator, Azure and Snowflake.
- Integrate data from enterprise applications, SaaS platforms and external partners through APIs, databases and file transfers.
- Implement incremental loads with retries, error handling and recovery.
- Add data checks for completeness, freshness and schema changes, and resolve pipeline failures.
- Document pipelines and maintain runbooks.
Preferred candidate profile
- 4+ years in data engineering with strong Python and SQL.
- Hands-on Snowflake and Azure storage/data services.
- Experience with an orchestration tool such as Prefect, Airflow or Dagster.
- Experience with CSV, JSON and Parquet, API integration and incremental ingestion patterns.
- Git, code reviews and automated testing.
- Good communication with US-based teams; must work US Pacific (PST) hours.