AWS Data Engineer
Posted 1
view
Summary
Crescent Techservices is hiring an AWS Data Engineer in Chennai (on-site 4 days/week; Chennai locals preferred, face-to-face interview required) with 5+ years of experience. Day to day involves building scalable data pipelines and ETL/ELT workflows with Python/PySpark, AWS Glue, Redshift, Athena, Kinesis, Lambda, Airflow/MWAA, and Terraform-managed infrastructure.
***Only Chennai locals will be preferred - F2F interview required***
Role: AWS Data Engineer
Experience : 5+ Years
Work Mode : Chennai - 4 Days (WFO)
Location: Chennai, Tamil Nadu
Job Description
- Design, develop, and optimize scalable data pipelines using Python / PySpark.
- Work extensively with Amazon Web Services (AWS) to build robust, scalable, and secure data solutions.
- Develop and manage data workflows using Apache Airflow / Amazon MWAA (Managed Workflows for Apache Airflow).
- Implement data ingestion and streaming solutions using Amazon Kinesis and Apache Kafka.
- Build and maintain ETL/ELT pipelines using AWS Glue, Amazon EMR, or Apache Spark.
- Write complex and optimized queries using Amazon Redshift, Amazon Athena, and advanced SQL.
- Design and implement scalable data storage solutions using Amazon S3 and AWS data services.
- Automate infrastructure provisioning and deployment using Terraform.
- Develop serverless data-processing solutions using AWS Lambda.
- Configure and manage AWS Glue Jobs, EventBridge schedules, monitoring dashboards, CloudWatch alerts, and notifications.
- Ensure data quality, reliability, scalability, security, and performance across data pipelines.
- Collaborate with cross-functional teams including Analytics, Product, DevOps, and Business teams.
- Implement and maintain CI/CD pipelines for data engineering workflows and infrastructure.
- Follow AWS best practices for IAM, security, cost optimization, high availability, and fault tolerance.