Lead Data Engineer

XPT Software Australia Pty Ltd | Contract

Melbourne, Australia | Posted on 09/04/2026

• XPT SoftwareAustralia PTY Ltd, incorporated in 2016, is a Software Services company
• XPT works with topclients across Australia in Banking, Insurance, Telecom,Retail, Energy, Mining and Manufacturingdomains.
• We have 120+technocrats in Australia working at our clientlocations.
• XPT SoftwareAustralia is part of group companies which has globalpresence across India & Europe.
• We have served100+ clients globally, fulfilling their onsite-offshoreneeds.

Job Description

Role Overview

We are seeking a highlyexperienced Lead Data Engineer to drive the strategy, architecture,delivery, and optimization of enterprise-scale data platforms on MicrosoftAzure. The ideal candidate will combine deep technical expertise with strongleadership, stakeholder management, and delivery governance capabilities tobuild scalable, secure, and cost-efficient data solutions.

Must-Have Skills

• Strongexpertise in SQL, Python, and PySpark
• Extensiveexperience with Azure Data Factory (ADF) and Azure Synapse Analytics.
• Hands-onexperience with Delta Lake architecture and modern data lakehouseimplementations.
• Advancedknowledge of Data Modeling and Data Warehousing concepts.
• Strongexposure to the Microsoft Fabric ecosystem.
• Provenexpertise in designing cloud-native data architectures andenterprise-scale solutions.
• Strong design thinking and problem-solving capabilities.
• Workingknowledge of CI/CD pipelines and DevOps practices.
• Experiencein cloud cost optimization, performance tuning, and resource governance.

Key Responsibilities

• Leadand own the end-to-end delivery of enterprise data platforms,including architecture, development, deployment, and optimization.
• Defineand drive the data platform roadmap, ensuring alignment withbusiness objectives and strategic priorities.
• Architectand govern scalable data pipelines, data models, data warehouses, andlakehouse solutions using Azure services.
• Providetechnical leadership to Data Engineering teams through design reviews,code reviews, and implementation of engineering best practices.
• Drivethe adoption and implementation of Microsoft Fabric, APIs, AzureFunctions, and Python-based solutions.
• Ensureplatform scalability, reliability, security, and operational excellencewhile optimizing cloud costs.
• Establishand enforce data governance, data quality, security, and compliancestandards.
• Implementand drive CI/CD, DevOps, and Agile delivery practices across thedata engineering landscape.
• Collaboratewith business stakeholders, architects, and technology teams to translatebusiness requirements into scalable technical solutions.
• Mentor,coach, and develop Data Engineering talent, fostering a culture ofcontinuous learning and innovation.
• Leverage GitHub Copilot and AI-assisted engineering tools to improve productivityand solution quality.
• Driveinnovation by evaluating emerging technologies and identifyingopportunities for platform modernization.

Experience

• 10+years of overall IT experience, including 10+ years in Data Engineering.
• Minimum 5+ years of leadership experience managing large-scale DataEngineering programs and teams.
• Proventrack record of leading cross-functional teams and delivering complexenterprise data transformation initiatives.
• Experiencebuilding, hiring, and scaling high-performing Data Engineering teams.
• Experienceworking within multi-vendor and globally distributed deliveryenvironments.
• Strongexperience in stakeholder management, delivery governance, andexecutive-level communication.

Preferred Skills

• Experiencebuilding and managing enterprise APIs and Azure Function Apps.
• Experiencein solution architecture, stakeholder engagement, and deliverygovernance.
• Azurecertifications such as:
• AzureSolutions Architect Expert
• Familiaritywith MLOps, Data Science, and AI-driven analytics solutions.
• Hands-onexperience with Power BI and enterprise reporting platforms.
• Experienceleveraging AI and Generative AI capabilities within Data Engineeringecosystems.
• Strongownership mindset with a focus on accountability and business outcomes.
• Excellentcommunication, stakeholder management, and influencing skills.
• Abilityto balance technical leadership with delivery and people managementresponsibilities.
• Strategicthinker with a strong focus on execution excellence.
• Strongconflict resolution and cross-functional collaboration skills.
• Adaptabilityand resilience in fast-paced, evolving environments.
• Passionfor mentoring teams and fostering a culture of innovation and continuousimprovement.