Data & AI Engineer
Summary
A Sydney healthcare-focused private equity firm seeks a Data & AI Engineer to run and harden a metadata-driven lakehouse on Microsoft Fabric and a governed AI platform (MCP services serving Claude and Teams), while building new data/AI capability for healthcare portfolio companies. Core stack: Python, Spark, SQL, Power BI, Azure, Docker, LLM APIs/RAG.
About Us
Sydney-based private equity firm dedicated to healthcare, seeking a Data & AI Engineer to take ownership of the data platform and AI products we have built for our portfolio companies across Australia and New Zealand.
The Role
You will run, harden and improve a metadata-driven lakehouse on Microsoft Fabric and a governed AI platform built as MCP services serving Claude and Microsoft Teams, then build new capability with the Head of Data & AI Engineering. The position offers exposure to multiple healthcare organisations and the chance to improve their operations and patient care through data and AI.
Key Duties
• Run the data platform across every company workspace: scheduled loads, backfills, failed-run triage, source and vendor issues, and the evidence that each load completed
• Own the AI platform in production: service health, access grants, data-release approvals, the agents and their tooling
• Keep the Power BI semantic models and the Azure infrastructure (containers, identity, secrets, source control and pipelines) deployed, current and documented
• Onboard new companies and new sources through configuration: discovery, authentication and schema profiling
• Diagnose and fix incidents end to end, write them up plainly, and turn recurring faults into platform fixes rather than repeat manual work
• Build new platform capability and AI solutions with the Head of Data & AI Engineering
• Work directly with finance, operations and transformation leaders at portfolio companies, most of whom have no IT function
Requirements
• At least four years of commercial experience in software and/or data engineering
• What you will use: Python written as software, Spark and Microsoft Fabric Lakehouses, SQL and dimensional modelling, REST API integration; LLM APIs and tool-calling with Claude, MCP servers, retrieval-augmented generation, prompt and guardrail design; Power BI and DAX; Linux, Docker, Azure, Entra ID and Azure DevOps
• Nobody knows everything, and we don't expect you to either. We are looking for people with the drive and initiative to pick up what they don't yet know
• AI-enabled engineering as a habit: directing coding agents and assistants, verifying what they produce with evidence, and owning the result as your own work
• A working understanding of data governance and PII and PHI handling obligations is highly regarded
• Direct, plain communication with technical and non-technical audiences
Benefits
• Competitive compensation
• A clear path from operating the platforms, to owning them, to leading new capability, in a function that will grow as the platforms reach more of the portfolio
• Exposure to multiple healthcare organisations and to both technical delivery and the business decisions behind it
• A small, senior team that works directly with you, without ceremony
• Central Sydney CBD location, hybrid, with periodic visits to portfolio companies
Industry
• Investment Management
Employment Type
Full-time, permanent
Skills
Sign in to read and join the discussion.