Data Engineer
Summary
Data engineer joining a diversified financial services firm's Business Insights and Data Integration team in Sydney: building data access layers, streamlining automated pipelines, packaging Docker images for VMs, and monitoring dataset quality. Stack centers on SQL/MS SQL, Azure, Snowflake and Python or R.
Our client is a diversified Financial Services business seeking an experience Data Engineer to join their Business Insights and Data Integration team team during a period of extended growth and acquisition, where you will gain exposure to financial markets data, APIs and modern cloud practices.
Key deliverables in the role:
- Partner closely with the business to understand their data product requirements and define the solution
- Build and maintain data access layers and apply business logic
- Monitor and maintain datasets, ensuring quality and integrity through robust QA processes.
- Streamline automated data pipelines, build Docker images and distribute to Virtual Machines.
- Oversee system processes, troubleshoot issues, and resolve failures promptly.
- Redesign and implement processes in line with evolving business needs.
Skills & Experience:
- 3-5 years' experience in a Data Engineering / Analyst role, with competency in SQL and data warehousing / MS SQL, Azure and Snowflake.
- Competent programming background (Python and/or R).
- Any exposure to Finance or Regulatory Reporting teams is highly regarded