AWS Data Engineer
Summary
Design, build, and optimize scalable data pipelines and cloud data platforms on AWS using Python, PySpark, and services like Glue, EMR, S3, Redshift, and Athena.
TCS Hiring | Azure Data Engineer | Noida
Greetings from Tata Consultancy Services (TCS)!
We are looking for As an AWS Data Engineer with strong expertise in Python, PySpark, and AWS Data Services to design, build, and optimize scalable data pipelines and cloud-based data platforms. The ideal candidate should have hands-on experience in big data processing, data integration, cloud migration, and data warehousing solutions on AWS.
Job Title-AWS Data Engineer
Location - Noida
Experience Required - 4 to 7 Years
Job Summary
Key Responsibilities
- Design, develop, and maintain scalable data pipelines using Python and PySpark.
- Build and optimize ETL/ELT workflows for large-scale data processing.
- Develop data solutions using AWS services such as Glue, EMR, S3, Lambda, Redshift, Athena, and RDS.
- Implement data ingestion and transformation processes from multiple sources.
- Work with structured and unstructured datasets in cloud environments.
- Optimize Spark jobs and improve data processing performance.
- Develop and maintain data lakes and data warehouse solutions.
- Collaborate with business stakeholders, data analysts, and architects to understand data requirements.
- Ensure data quality, governance, and security standards are followed.
- Participate in code reviews, testing, deployment, and support activities.
Required Skills
Core Skills
- AWS Cloud
- Python
- PySpark
- Apache Spark
- SQL
- Data Engineering
- ETL Development
- Data Warehousing
AWS Services
- AWS Glue
- Amazon S3
- Amazon EMR
- AWS Lambda
- Amazon Redshift
- Athena
- RDS
- IAM
- CloudWatch
Big Data Technologies
- Hadoop
- Spark SQL
- Data Lake
- Distributed Computing
- Batch Processing
- Real-Time Data Processing
Preferred Skills
- Airflow
- Kafka
- Snowflake
- Databricks
- Terraform
- Docker
- CI/CD
- Git/GitHub