Data Engineer-NSW
Data Engineer | Sydney, NSW
We are looking for an experienced Data Engineer (9–14 Years) to join a high-performing team delivering enterprise-scale data platforms and real-time data solutions on AWS.
Must Have Skills
- AWS Cloud Services
- Python & PySpark
- Apache Airflow (MWAA)
- SQL
- Amazon Redshift
- AWS SageMaker Unified Studio
- AWS Kinesis / Kafka (Real‑Time Streaming)
Key Responsibilities
- Design and develop scalable batch and real‑time data ingestion frameworks.
- Build and optimize data pipelines using AWS services and modern data engineering practices.
- Develop low‑latency streaming solutions using Kinesis, Kafka, or similar technologies.
- Implement data transformations, orchestration workflows, and monitoring solutions.
- Work with Data Warehouses, Data Lakes, and Lakehouse architectures.
- Collaborate with cross-functional teams to deliver robust and scalable data solutions.
Required Experience
- Strong expertise in AWS, Python, PySpark, Airflow, and Redshift.
- Hands‑on experience with SageMaker Unified Studio.
- Experience with relational and NoSQL databases (Oracle, MongoDB, DynamoDB, Snowflake, Teradata, etc.).
- Proven experience building real‑time and batch data pipelines.
- Knowledge of CI/CD, Git, Infrastructure as Code (Terraform/CloudFormation).
- Data Modelling experience is highly desirable.