Senior Data Engineer – dbt, Snowflake and AWS – Sydney

Delivery Centric is seeking an experienced Data Engineer with strong expertise in dbt, Snowflake SQL, and AWS to develop and maintain data transformation pipelines. The role involves building governed, consumer-ready datasets, developing data workflows, supporting ingestion processes, and ensuring data quality across financial data pipelines.

Key Responsibilities

• Build and maintain dbt transformation models across multiple pipeline layers, from raw ingestion to governed, consumer-ready datasets.
• Write Snowflake SQL for complex transformations, including type casting, deduplication, incremental loads, and surrogate key generation.
• Develop and debug Apache Airflow DAGs running on AWS ECS.
• Support Python-based AWS Lambda ingestion processes, including file validation, control file generation, and S3 event handling.
• Maintain source-to-target mapping documentation and align data models with business requirements and data specifications.
• Support downstream consumer onboarding through data-sharing mechanisms and event-driven notifications.
• Participate in code reviews, develop YAML-based data quality tests, and manage tickets through the full delivery lifecycle, from design to production.

Required Skills & Experience

• Strong SQL skills.
• Proficiency in dbt Core and Snowflake.
• Experience developing and maintaining Apache Airflow DAGs.
• Working knowledge of AWS services, including S3, Lambda, MWAA, ECS, Glue Data Catalog, Lake Formation, SQS, and EventBridge.
• Experience working with fixed-format or structured financial data files.
• Experience with CI/CD pipelines using GitHub Actions.

Ready to take on a Senior Data Engineer – dbt, Snowflake and AWS role in Sydney with Delivery Centric? Apply now to join a team that delivers excellence and realises value for its clients.