Cloud data engineer
Posted 2
views
Summary
Designs, builds, and maintains automated data pipelines and ETL processes using Python, Snowflake, AWS (Glue, Batch, Step Functions) and Azure (Data Factory, Logic Apps, Functions), with Terraform and CI/CD for deployment. A 4-5 year onsite role in Indian tech hubs that also involves mentoring junior engineers.
Job Title : Cloud Data Engineer
Experience : 4 to 5 Years
Location : Noida / Gurgaon / Hyderabad / Bangalore / Pune
Notice Period : Immediate (15 Days notice period)
Responsibilities- Design, develop, and maintain automated data pipelines and ETL processes.
- Create and optimize data tables and views in Snowflake.
- Work with datasets across Azure, AWS, and various structured/unstructured formats.
- Ensure data security, privacy, and compliance with industry and organizational standards (e.g., BHP standards).
- Support and mentor junior team members by providing guidance on data modelling, data management, and data engineering best practices.
- Strong hands-on experience in data pipeline development, ETL scripting using Python, and handling data formats like JSON, CSV, etc.
- Proficiency in AWS services such as:
- AWS Glue
- AWS Batch
- AWS Step Functions
- Experience with Azure services, including:
- Azure Data Factory
- Azure Logic Apps
- Azure Functions
- Azure Blob Storage
- Solid understanding of:
- Data management principles
- Data structures & storage solutions
- Data modeling techniques
- Strong programming skills in:PowerShell
- Bash scripting
- Advanced SQL skills, including writing and optimizing complex queries.
- Working experience with Terraform and CI/CD pipelines for infrastructure and deployment automation.