Data engineer

Описание:

At Macquarie, our Data Services Team drives innovation by delivering a diverse suite of data products that empower data-driven decision-making and enhance operational efficiency. With a strong focus on engineering, data science, and analytics, the team delivers innovative solutions that empower business users primarily trading teams to tackle complex challenges and unlock new opportunities.

Задачи:

designing, building, and optimising a cutting-edge, petabyte-scale data platform powered by modern cloud technologies. manage and enhance a petabyte-scale Data Lake create secure, efficient, and scalable environments for our data platforms. You'll leverage cloud-native technologies and AWS tools such as AWS S3, EKS, Glue, Airflow, Trino, and Parquet, while preparing to adopt Apache Iceberg for even greater performance and flexibility. You'll tackle high-performance data workloads, ensuring seamless execution of massive queries, including 600+ billion-row queries in Redshift, by designing and maintaining robust, scalable infrastructure. Our flat structure means that you will directly contribute to our strategy while taking ownership of a diverse range of projects utilising the latest technologies.

Требования:

A dynamic individual with a strong Data, DevOps and Engineering background who loves to solve data problems and build automation and CI/CD Pipelines in the data space and cloud infrastructure. Good understanding of modern Data Platforms, Databases, Data Lakes, Data Warehouses and Query Engines, SQL/DDLs Experience with Python coding/testing or any Cloud-based technology (AWS preferred) Good understanding of Hosting Platform Linux/Unix Будет плюсом: EKS and Container experience is a plus

Условия:

• 1 wellbeing leave day per year and a minimum of 25 days of annual leave.
• 26 weeks' paid parental leave for primary caregivers along with 12 days of paid transition leave upon return to work and 6 weeks' paid leave for secondary caregivers
• Paid fertility leave for those undergoing or supporting fertility treatment
• 2 days of paid volunteer leave and donation matching
• Access to a wide range of salary sacrificing options
• Benefits and initiatives to support your physical, mental and financial wellbeing including, comprehensive medical and life insurance cover
• Access to our Employee Assistance Program, a robust behavioural health network with counselling and coaching services
• Access to a wide range of learning and development opportunities, including reimbursement for professional membership or subscription
• Access to company funded emergency and backup dependent care services
• Recognition and service awards
• Hybrid and flexible working arrangements, dependent on role
• Reimbursement for work from home equipment