Data Engineer / Cloud Engineer (AWS)

Job Description Data Engineer / Cloud Engineer (AWS)

Position: Data Engineer / Cloud Engineer
Experience: 6-8 Years
Location: Pune
Employment Type: Full-Time

Role Overview

We are seeking a highly skilled Data Engineer / Cloud Engineer with strong expertise in AWS cloud services, modern data engineering practices, and scalable data platform development. The ideal candidate will have hands-on experience designing and building cloud-native data solutions, developing large-scale ETL/ELT pipelines, and implementing DevOps and Infrastructure-as-Code practices. Exposure to Microsoft Copilot, Generative AI, and AI/ML technologies is highly desirable.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines and cloud-native data solutions on AWS.
• Build and optimize ETL/ELT processes for structured and unstructured data.
• Develop and manage data lakes and data warehouse architectures.
• Work with large-scale distributed data processing frameworks such as Apache Spark.
• Implement Infrastructure as Code (IaC) using Terraform and automate cloud deployments.
• Design and manage containerized workloads using Kubernetes.
• Establish and maintain CI/CD pipelines to support efficient software delivery.
• Collaborate with data scientists, architects, and business stakeholders to deliver data-driven solutions.
• Explore and leverage AI/ML and Generative AI capabilities to enhance business outcomes.
• Ensure data quality, reliability, security, and governance across cloud environments.
• Troubleshoot complex technical issues and drive continuous platform improvements.
• A hands-on AWS Data Engineer with strong cloud engineering capabilities, experience in building scalable data platforms, and exposure to Copilot/GenAI technologies, capable of driving end-to-end data modernization initiatives.

Required Skills & Experience

Cloud & Data Engineering

• AWS Services: S3, RDS, Glue, EMR, Lambda
• Data Lake and Data Warehouse Architecture
• ETL/ELT Pipeline Development
• Data Modeling and Performance Optimization

Programming & Big Data

• Python
• Scala
• Apache Spark

Databases

• SQL Databases: MySQL, Redshift
• NoSQL Databases: MongoDB
• Strong SQL and data querying skills

DevOps & Infrastructure

• Terraform and Infrastructure as Code (IaC)
• Kubernetes and Containerized Applications
• CI/CD Pipeline Development
• DevOps Best Practices

AI & Emerging Technologies

• AI/ML Fundamentals
• Generative AI Fundamentals
• Experience with Microsoft Copilot or other Agentic AI tools

Preferred Qualifications

• Experience with enterprise-scale cloud migration and modernization initiatives.
• Knowledge of data governance, security, and compliance best practices.
• Exposure to MLOps and AI-driven automation frameworks.
• AWS Certification(s) preferred.
• Strong analytical and problem-solving capabilities.

Soft Skills

• Excellent communication and stakeholder management skills.
• Ability to work in a fast-paced, collaborative environment.
• Strong problem-solving and troubleshooting mindset.
• Passion for learning and adopting new technologies.