AWS Data Engineer
Posted
Summary
TCS is hiring a 5–10 year experienced AWS + PySpark Data Engineer for an on-site role in Pune (via a walk-in drive). Day to day involves building big data pipelines on AWS (EMR, S3, Lambda, SNS, SQS), PySpark/Spark optimization and debugging, Python scripting, SQL, and applying data architecture patterns like Data Vault, data mesh, and data fabric.
Job description
Greetings!
TCS India presents excellent opportunities for IT professionals.
TCS Walk-in Drive @Pune Location
Role :- AWS+Pyspark Data Engineer
Experience:- 5-10 years
Location:- Pune
Date:- 22nd August, Saturday
Time:- 9:30 AM-1 PM
Required Technical Skill Set:-
- Knowledge of Pyspark, Big Data experience, AWS EMR, S3, IAM, Lambda, SNS, SQS
- Good Spark, Pyspark, Big Data experience
- Spark UI/Optimization/debugging techniques
- Good python scripting skills
- Intermediate SQL exposure Subquery, Joins, CTEs
- Database technologies
- AWS EMR, S3, IAM, Lambda, SNS, SQS
Responsibility of / Expectations from the Role
- 5 10 years of total experience with good knowledge of Knowledge of Pyspark, Big Data experience, AWS EMR, S3, IAM, Lambda, SNS, SQS, Python and AWS services
- Good python, Pyspark scripting skills
- Spark UI/Optimization/debugging techniques
- Intermediate SQL exposure Subquery, Joins, CTE’s
- Good understanding of Database technologies
- Excellent communication skills to liaise with Business & IT stakeholders.
- Expertise in planning execution of a project and efforts estimation.
- Understanding of Data Vault, data mesh and data fabric architecture patterns.
- Exposure to working in Agile ways of working.