Data Engineer - Contract - Sydney
Posted 4
views
Summary
Contract Data Engineer role in Sydney (6 months with possible extension) building data pipelines, workflows, and a data lake on AWS. Core stack: Python (Pandas, PySpark, boto3), Apache Airflow (MWAA), Amazon Redshift, S3, plus AWS services like Glue, Athena, Lambda, KMS, and Secrets Manager.
Urgent requirement of Data Engineer - Contract - Sydney
Requirements
- Must have 5+ Years of experience
- Advanced proficiency in Python, including libraries such as Pandas, PySpark, and boto3
- Experience designing workflows in Apache Airflow (MWAA)
- Hands-on experience with Amazon Redshift for analytics and data warehousing
- Solid SQL skills and experience with data modeling and transformation
- Comfortable with Amazon S3, including setting up data lake architecture
- Familiar with AWS core services: EC2, S3, IAM, Lambda
- Experience using AWS Secrets Manager and AWS KMS for secure data access
- Knowledge of additional ETL/ELT tools like AWS Glue, AWS Athena
- Familiarity with DevOps practices and CI/CD pipelines
- Experience working in agile teams and data-focused environments
- Knowledge in read and understand the JavaScript (Node.js/Express)
- Very Good Communication skillsâ
Duration: 6 Months and possible extension
Eligibility: Australian/NZ Citizens/PR Holders only
Email: