Data Platform Engineer
Summary
12-month contract Data Platform Engineer in Sydney, working in a client's Technology team to migrate customers from Cloudera to AWS-native data services (AWS Glue, Lake Formation, EMR, S3, Redshift, Athena). Day to day: build migration and synchronization automation, ensure data integration performance, and contribute to incident response and platform documentation.
Get recognition and reward working with this a pioneering industry leader, as they embark on a transformative journey! We are currently seeking a passionate Data platform engineer for an exciting 12-month contract opportunity within their highly respected Technology team. This pivotal role demands a seasoned professional with robust expertise in AWS Glue, AWS Lake formation. This is your opportunity to make a profound impact in in migrating customers from Cloudera to AWS native data services, ensuring a seamless transition and optimal performance.
Key Responsibilities:
- Ensure smooth data integration across platforms while maintaining integrity and performance.
- Build robust automation for data migration and synchronization workflows.
- Partner with data engineers, platform engineers, and stakeholders to drive cohesive delivery.
- Contribute to incident response plans and platform certification documentation.
Required Skills and Experience:
- Proven experience with AWS Glue, Lake Formation, EMR, and related services (S3, Redshift, Athena).
- Hands-on experience migrating from Cloudera to AWS, especially involving HMS.
- Proficiency in Python, Bash, YAML, and Infrastructure as Code tools.
- Analytical mindset with a proactive approach to troubleshooting and optimization.
- Able to translate complex technical concepts for diverse audiences.
- Collaborative spirit with a track record of working effectively in cross-functional teams.
Mane Consulting specialise in Data & Analytics.