Data Engineer (Snowflake & AWS)
Position: Data Engineer (Snowflake & AWS)
Location: Hyderabad/ Bangalore
Job Summary
We are looking for an experienced Data Engineer with strong expertise in Snowflake and AWS to design, develop, and maintain scalable data pipelines and cloud-based data solutions. The ideal candidate should have hands-on experience in building ETL/ELT frameworks, data warehousing, data modeling, and processing large-scale datasets using modern cloud technologies.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines and ETL/ELT processes.
- Build and optimize data solutions using Snowflake and AWS services.
- Develop and maintain data ingestion, transformation, and orchestration workflows.
- Work with structured and unstructured data from multiple sources.
- Implement data quality, validation, monitoring, and governance processes.
- Optimize Snowflake data warehouse performance, storage, and query execution.
- Collaborate with business stakeholders, data analysts, and engineering teams to understand data requirements and deliver solutions.
- Create and maintain data models, schemas, and documentation.
- Troubleshoot production issues and ensure high availability of data platforms.
- Participate in code reviews, testing, deployment, and support activities.
Required Skills
- 5+ years of experience in Data Engineering.
- Strong hands-on experience with Snowflake (mandatory).
- Strong hands-on experience with AWS (mandatory), including services such as S3, Glue, Lambda, Redshift, Athena, EMR, ECS, or related services.
- Expertise in SQL and performance tuning.
- Strong programming skills in Python and PySpark.
- Experience with ETL/ELT tools and frameworks.
- Hands-on experience with data orchestration tools such as Airflow, ADF, or similar.
- Strong understanding of Data Warehousing concepts and Data Modeling (Star Schema, Snowflake Schema).
- Experience working with large-scale data processing and distributed computing frameworks.
- Knowledge of CI/CD, Git, and DevOps practices.
Qualifications
- Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
- Strong communication and stakeholder management skills.
- Ability to work independently and collaboratively in a fast-paced environment