Data Engineer
Overview
Talent Acquisition Consultant @APAC Carecone Australia
Location: Sydney
Permanent Role.
Job Description:
- A hands-on engineer with deep experience working with a variety of AWS services for ingestion, curation, storage, orchestration, data management, analytics, and distribution.
- Good knowledge of data modeling and how to structure data within a data warehousing environment, while following best practice data management standards.
- Solid data product architecture and solution design experience with a good working knowledge of DevSecOps practices to achieve high levels of automation across complex data pipelines.
- Experience in real-time streaming using Confluence Kafka and AWS services.
- Experience with Airflow, AWS Glue, Apache Iceberg, Athena, RedShift, and DataZone.
- Experience in Data visualization tools such as Tableau/Power BI/QuickSight.
- Solid experience in Python, Spark and Terraform/Terragrunt.
Nice to have
- Experience working within a platform/product operating model where frameworks and development kits are leveraged to achieve standardization, re-use, and scale.
- A working knowledge of data mesh/data product concepts with federated data ownership at the domain-level, but operating on centralized platforms and governance.
- Experience working in the Capital Markets domain and understanding of derivative products.
Contact
Interested Candidates can share their CVs at kranthi.kumar@carecone.com.au
Qualifications & Requirements
- Responsibilities: The role involves hands-on engineering with AWS data services, data modeling, data product architecture, DevSecOps automation, real-time streaming, and data visualization.
- Prerequisites: Proficiency in Python, Spark, Terraform/Terragrunt; experience with Airflow, AWS Glue, Apache Iceberg, Athena, RedShift, and DataZone; experience with visualization tools (Tableau/Power BI/QuickSight).
Seniorities
- Mid-Senior level
Employment type
- Full-time
Job function
- Information Technology
Industries
- Staffing and Recruiting