Data Engineer
Job Title
Senior AWS Data Engineer
Mode of Work
Hybrid (1-2 days onsite)
Responsibilities
- Lead the design and implementation of AWS-based data migration solutions using services such as AWS DataSync, AWS SCT (Schema Conversion Tool), and Python to enable secure and efficient data movement.
- Develop and maintain data orchestration workflows using AWS Step Functions and/or Apache Airflow, ensuring scalable, reliable, and automated ETL/data migration processes.
- Design and optimize cloud-based data storage solutions leveraging Amazon S3 and Amazon Redshift, focusing on performance, scalability, and data integrity.
- Optimize migration jobs for performance, conduct data validation and testing, troubleshoot issues, and ensure successful deployments across development, UAT and production environments.
- Develop, update, and deploy AWS CDK (Cloud Development Kit) infrastructure for Dev/UAT/Prod environments while following CI/CD and infrastructure-as-code best practices.
- Collaborate with project managers and cross-functional teams, including Infrastructure, Cloud Engineering, Development, Data, and Operations, to drive migration planning, coordinate onsite/offshore activities, track project progress, resolve blockers, and ensure successful project delivery.