AWS Data Engineer
Posted
Summary
An AWS Data Engineer in Sydney who designs and maintains cloud-native data platforms and scalable ETL/ELT pipelines using AWS services (S3, Glue, EMR, Athena, Aurora PostgreSQL), Python, SQL, and Spark/PySpark, with CI/CD via GitHub Actions and event-driven delivery.
- Design, develop, and maintain cloud-native data platforms and scalable ETL/ELT pipelines using AWS services, Python, SQL, and Spark/PySpark.
- Build and optimize data processing workflows using AWS S3, Glue, EMR, Athena, and Aurora PostgreSQL.
- Implement CDC, data modeling, data integration, and event-driven data pipelines to support reliable and efficient data delivery.
- Establish data governance, monitoring CI/CD, and operational processes using GitHub Actions and related DevOps practices.
- Collaborate with stakeholders and Agile teams to troubleshoot data issues, improve platform performance, and deliver high-quality data solutions.
Skills Required:
- Strong hands-on experience with SQL, Python, AWS, ETL/ELT, data modeling, and Spark/PySpark.
- Proficiency in AWS S3, Glue, EMR, Athena, and Aurora PostgreSQL, with experience supporting production data platforms.
- Practical knowledge of CDC, data governance, CI/CD, GitHub Actions, monitoring, and operational databases.
- Exposure to Kafka/MSK, Terraform, and event-driven architectures; experience with Snowflake and dbt is an added advantage.
- Strong problem-solving, stakeholder management, communication, and Agile delivery skills.