Senior Data Engineer
Summary
Senior Data Engineer in New South Wales, Australia who designs and builds scalable end-to-end data pipelines on AWS — developing ETL/ELT workflows with Glue, PySpark, Python and Lambda, integrating S3, Athena, Redshift and RDS, and orchestrating with Airflow, plus data quality, modelling and CI/CD work. Requires existing Australian work rights.
Senior IT Recruiter | Cyber Security & Cloud Roles | • IAM • SailPoint • Network Security | Citizen, PR & Valid Visa Holders | NSE 1 and NSE 2…
🛂 Eligibility: Must have valid Australian work rights (Citizen / PR / Valid Visa holders)
Key Responsibilities
- Design and build scalable end-to-end data pipelines using AWS services.
- Develop and optimise ETL/ELT workflows using AWS Glue, PySpark, Python, and Lambda.
- Build efficient data processing solutions integrated with S3, Athena, Redshift, and RDS.
- Orchestrate and schedule data pipelines using Apache Airflow or AWS Managed Airflow.
- Implement data quality checks, schema validation, and monitoring to ensure reliable data delivery.
- Experience in data engineering within large-scale, data-intensive environments.
- Strong hands‑on expertise in AWS services including Glue, S3, Lambda, Athena, Redshift, and IAM.
- Advanced proficiency in PySpark, Python, and distributed data processing frameworks.
- Practical experience using Airflow for orchestration and workflow management.
- Solid understanding of data modelling, partitioning strategies, performance tuning, and CI/CD practices.
Please drop your CV to veni@kaizenglobaltechnologies.com
Referrals increase your chances of interviewing at Kaizen Global Technologies by 2x.
Seniority level
Mid‑Senior level
Employment type
Full‑time
Job function
Information Technology
Industries
IT Services and IT Consulting