Data Engineer

Data EngineerWe are looking for a Data Engineer with hands-on experience in Azure Data Factory to develop, build and maintain data pipelines and analytics infrastructure that support operational efficiencies and informed business decisions. This is a full-time role is based at our Head Office in Mile End.The role:Develop and maintain data architecture and infrastructure that support reliable analytics and reportingBuild, maintain and monitor Azure Data Factory pipelines to integrate and transform data across systemsDevelop and troubleshoot Apache Spark data processing workloads and support their operation in Kubernetes environmentsDesign, develop and optimise Power BI semantic models, including dimensional modelling, data relationships, DAX measures, row-level security and performance tuningDevelop and support advanced analytics platforms, collaborating with analytics teams to prepare, validate and transform data for reproducible machine learning (ML) workflowsDesign scalable database schemas and administer, maintain and optimise databases and queries to support dependable data access and useApply data governance standards through metadata and lineage management, access controls, and data validation, reconciliation and quality monitoring to safeguard data integrityPartner with stakeholders to deliver practical data solutions that meet business needsContribute to other data engineering activities as requiredAbout you:You translate business needs into reliable, well-governed data solutions and communicate clearly with non-technical stakeholders. The requirements below are essential unless marked desirable:A degree or postgraduate qualification in computing or a related technical discipline, or equivalent experienceExperience delivering and supporting reliable production data pipelines integrating complex sources in a large-scale organisationEssential: Azure Data Factory expertise in ETL/ELT orchestration, incremental loads, monitoring, error handling and performance troubleshootingExperience with Apache Spark (PySpark or Spark SQL) for distributed data processing, and familiarity with Kubernetes-based deployments, monitoring and troubleshootingDesirable: Microsoft Fabric experience with lakehouses, warehouses, data pipelines or notebooksStrong coding and technical skills to develop efficient, maintainable solutions for data transformation, automation and analyticsHands-on experience with modern data engineering tools for data integration, transformation, orchestration and monitoringPower BI semantic model development, including dimensional modelling, relationships, DAX, row-level security and performance tuningUnderstanding of ML concepts and practical data preparation, validation and transformation for reproducible workflows with analytics teamsDatabase architecture and data modelling experience, including scalable schemas and database and query optimisationPractical data governance experience covering metadata, lineage, access controls and data integrity through validation, reconciliation and quality issue resolutionStrong analytical and root-cause investigation skills to evaluate solutions and resolve complex data issues using sound architecture and governance principlesStrong stakeholder engagement to clarify requirements, explain trade-offs and collaborate across business and technical teamsAbility to prioritise competing demands, meet deadlines and own solutions from development to operational supportCommitment to clear documentation and continuous improvement in data reliability, performance and maintainabilityA satisfactory National Criminal History check less than 12 months old at commencement is required for the successful candidate.How to Apply: To apply online press ‘Apply’ now. ACH Group celebrates and encourages workforce diversity and does not discriminate on the basis of gender, age, race, sexual orientation, gender identity, religious beliefs, disability or any other basis.About ACH Group: At ACH Group we believe that older people should feel valued, respected, connected in their communities and supported to live a good life. We love what we do, aren’t afraid to take action, constantly put our hands up for challenges and celebrate the uniqueness of our community. Most importantly, we bring our best.If you share our belief, join our team of 1800 employees and hundreds of volunteers and take delight in knowing that you're making a contribution to the lives of older people. You'll do so while enjoying a rewarding career pathway, ongoing training, competitive salary options and a passionate, flexible workplace.