Aws Data Engineer

Key Skills: AWS Ecs, DynamoDb

Roles and Responsibilities:

• Design and develop scalable batch and streaming data pipelines on AWS.
• Build transformation and processing workflows using Python and PySpark.
• Develop and manage data processing jobs using AWS Glue and Amazon EMR.
• Orchestrate dependent data workflows and production schedules using AWS Step Functions.
• Implement data integrations and cloud-based services with attention to reliability, security, and operational efficiency.

Skills Required:

• 4 - 10 years of relevant experience in data engineering or big data platform development.
• Strong hands-on experience designing and implementing data engineering solutions on AWS.
• Proficiency in Python and PySpark for large-scale data processing.
• Experience developing and operating data pipelines using AWS Glue and Amazon EMR.
• Understanding of distributed data processing, cloud architecture, and production data workflows.

Good to Have:

• Experience with Amazon ECS and Amazon DynamoDB.

Education: Bachelor's degree in Computer Science, Information Technology, Engineering, or a related discipline.