AWS Data Engineer
NewBe an early applicantSummary
Builds and operates AWS data pipelines for Tata Consultancy Services in Dombivli, India: developing ETL workflows, processing real-time streams with Kinesis, and orchestrating data movement with Lambda or Spark on EMR. Also manages S3 data lakes, RDS/DynamoDB databases, and Redshift data warehouses.
Pipeline Development & ETL Operations
- Build robust Extract, Transform, Load (ETL) workflows.
- Process real-time data streams using Amazon Kinesis.
- Orchestrate data movement with serverless tools like AWS Lambda or Apache Spark on Amazon EMR.
Data Storage & Architecture Management
- Design and manage secure data lakes on Amazon S3.
- Configure relational and NoSQL databases via Amazon RDS and Amazon DynamoDB.
- Structure data warehouses using Amazon Redshift for fast querying