AWS Data Engineering Lead
Summary
Specialist Lead in Deloitte's AI & Data consulting team: designs and builds large-scale AWS data platforms (Glue, Redshift, Athena, Lambda, MSK, SageMaker) with Airflow and dbt, leads multidisciplinary teams, builds SQL/Python ETL/ELT pipelines, and embeds DevOps/FinOps plus AI/agentic automation for major clients.
Job Requisition ID:41231
AWD Data Engineering Specialist Lead- Access to free and confidential coaching for you and your family including wellbeing, financial and nutrition coaching.
- 18 weeks paid parental leave + 12 months return to work support (work 4 days and get paid 5).
- International PlaceFlex to work from select countries for a period.
As a Specialist Lead in our AI & Data team, you’re not just building data pipelines, you’re the bridge between complex data challenges and robust, cloud-native solutions. You’ll combine deep technical grit with sharp consulting acumen to design, build, and optimize large-scale AWS data platforms for some of our highest-profile clients.
- Architect & Build: Design highly scalable, secure data platforms using the latest and greatest from AWS (Glue, Redshift, Athena, RDS, Lambda, MSK, Managed Flink, SageMaker, S3, LakeFormation, Quick ) alongside tools like Airflow and dbt.
- Lead the Charge: Direct multidisciplinary teams to untangle complex data engineering, platform automation, CI/CD, and advanced analytics problems.
- Pioneer AI & Agentic Solutions: Drive the adoption of cutting-edge AI and agentic workflows to dramatically scale and accelerate the end-to-end delivery of modern data platforms.
- Automate Everything: Embed DevOps and FinOps best practices—infrastructure as code, platform monitoring and data control planes, and cost optimization.
- Connect the Dots: Partner with Solution Architects and business stakeholders to translate lofty goals into rock-solid technical blueprints.
- Engineer at Scale: Build production-grade ETL/ELT pipelines using SQL, Python, and big data frameworks to manage complex and diverse data sources.
- Mentor & Grow: Coach, inspire, and set the technical standard for your teams.
- Innovate: Step beyond pure project delivery. Shape Deloitte's IP, run hackathons, host webinars, and help define the future of our data offerings.
Our diverse AI& Datateamcomprisesover 500 specialist practitioners across Australia, each of whom are constantly curious and excited about combining their business acumen and technologicalexpertiseto create data-centric solutions that help solve complex problems andtransform, orreinvent our client’s business.
Our Data & AI teamwork with public and private sector clients helping them to design and implement world leading solutions and capabilities. From solving air and ground transport network issues through our industry-first Optimal Reality digital twin solution, bringing automation capabilities to vaccine rollout programs, to helping our clients move to a sustainable world, we are the partner of choice for our clients and our alliance vendors.
Our relationships with market leading vendors such as AWS,Databricks, Google,dbtLabs, Snowflake, Salesforce, and Informatica enable our practitioners to be at the forefront of new and emerging capabilities and to deliver our suite of services at scale. We are consistently recognised as leaders in Cloud, Data, Analytics and AI, including in the latest analyst reports.
We embrace diversity,equityand inclusion.We have a diverse collection of people from differentbackgrounds, with different experiences, gender identities, abilitiesandthinking styles. What binds us together is a shared commitment tovalueeveryone’sperspectiveand to cultivate inclusion; so that our work environment is a safe space we can all belong.
Enough about us, let’s talk about youYou’re a technical heavy-hitter who still knows how to talk to human beings.
You’ve been in the trenches building production-grade systems and you know what it takes to lead a team across the finish line.
- Experience: 5+ years delivering large-scale, multi-cloud Data & AI platforms (with a heavy focus on AWS), ideally within consulting.T
- The Tech Stack: Deep hands-on experience with AWS Data & AI services, plus serious chops in SQL and Python.
- Big Data & Streaming: Proven capability in engineering enterprise-grade streaming architectures and scalable data stores, leveraging modern frameworks such as Apache Spark, Flink, Storm, and Kafka.
- Architecture & Modeling: Solid background in data modeling, modern data warehousing, and data lake design.
- Certifications: AWS Certified Solutions Architect (Associate required, Professional highly preferred) amongst others.
- Leadership: Proven experience leading technical teams, communicating with non-technical stakeholders, and driving real change.
At Deloitte, we focus our energy on interesting and impactful work.We’realways learning,innovatingand setting the standard; making a positive difference to our clients and our society. We putcoaching at the heart of what we do, helping our people grow their careers in any direction – whether it be up, moving into something new, or even moving across the world.
We embrace diversity,equityand inclusion.We have a diverse collection of people from differentbackgrounds, with different experiences, gender identities, abilitiesandthinking styles. What binds us together is a shared commitment tovalueeveryone’sperspectiveand to cultivate inclusion; so that our work environment is a safe space we can all belong.
We value in-person connection with our clients and our colleagues.We offer several ways for you to work flexibly so that you can serve your clients, stay connected with your team, and manage your personal priorities.
We help you live and work well.To support your personal and professional life, we offer a range of perks and benefits, including retail discounts, wellbeingleave, paid volunteering days, twelveflexible working options, market-leading parental leave and return to work support package.
Next StepsBy applying for this job, you’ll be assessed against the Deloitte Talent Standards. We’ve designed these standards so that you can grow in your career, and we can provide our clients with a consistent and exceptional Deloitte employee experience globally.The preferred candidate will be subject to background screening by Deloitte or by their external third-party provider.
#J-18808-Ljbffr