Staff Data Engineer
Posted 7
views
Summary
Staff Data Engineer in Sydney who builds and maintains data pipelines end to end: dbt transformation models, complex Snowflake SQL, Apache Airflow DAGs on AWS ECS, and Python/AWS Lambda ingestion handling S3 events — turning raw data into governed, consumer-ready datasets.
Responsibilities • Building and maintaining dbt transformation models across multiple pipeline layers — from raw ingestion through to governed, consumer-ready datasets • Writing Snowflake SQL for complex transformations: type casting, deduplication, incremental load logic, surrogate key generation • Developing and debugging Apache Airflow DAGs on AWS ECS • Contributing to AWS Lambda-based ingestion( Python) — file validation, control file generation, S3 event handling • Maintaining source-to-ta…