Senior Data Engineer
Posted Updated
Description
Coforge is seeking a Senior Data Engineer to design, implement, and optimize scalable data pipelines in AWS and Snowflake. You will craft production-grade Python solutions, integrate external APIs/SDKs, and contribute to governance, quality, and reliability across the data platform.
Responsibilities include implementing Airflow-based orchestration, dbt transformations, and IaC with Terraform, while ensuring cost efficiency and observability through Grafana and CloudWatch.
Design and maintain scalable data pipelines using Airflow (MWAA). Develop production-grade Python code for API/SDK integrations and data processing. Model and evolve Snowflake warehouse; build transformations with dbt. Define architecture, development standards, and best practices. Manage infrastructure as code with Terraform. Ensure data quality, monitoring and reliability using Grafana and CloudWatch. Implement data governance practices including cataloging and lineage. Optimize cost and performance across Snowflake, AWS and Spark. Build and maintain CI/CD processes for data pipelines and models. Advanced Python (3.x) in production applications and API integrations. Strong T-SQL with performance tuning. Snowflake data warehousing and dbt modeling knowledge. Experience with AWS services (S3, Lambda, EMR, ECS) and IaC tooling.Skills
Sign in to read and join the discussion.