Data Engineer
Summary
Senior AWS Data Engineer designs and implements cloud data migration solutions using AWS services like DataSync, Redshift, and CDK, and automates ETL workflows with Step Functions or Airflow.
Job Title
Senior AWS Data Engineer
Mode of Work
Hybrid (1-2 days onsite)
Responsibilities
- Lead the design and implementation of AWS-based data migration solutions using services such as AWS DataSync, AWS SCT (Schema Conversion Tool), and Python to enable secure and efficient data movement.
- Develop and maintain data orchestration workflows using AWS Step Functions and/or Apache Airflow, ensuring scalable, reliable, and automated ETL/data migration processes.
- Design and optimize cloud-based data storage solutions leveraging Amazon S3 and Amazon Redshift, focusing on performance, scalability, and data integrity.
- Optimize migration jobs for performance, conduct data validation and testing, troubleshoot issues, and ensure successful deployments across development, UAT and production environments.
- Develop, update, and deploy AWS CDK (Cloud Development Kit) infrastructure for Dev/UAT/Prod environments while following CI/CD and infrastructure-as-code best practices.
- Collaborate with project managers and cross-functional teams, including Infrastructure, Cloud Engineering, Development, Data, and Operations, to drive migration planning, coordinate onsite/offshore activities, track project progress, resolve blockers, and ensure successful project delivery.