Data Engineer - Manager
Summary
The Data Engineer Manager leads teams in designing and deploying scalable data pipelines, lakehouse architectures, and AI-enabled solutions using Python, SQL, Spark, and cloud platforms. This client-facing role involves technical leadership, mentoring staff, and driving digital transformation projects.
Industry/Sector
Not ApplicableSpecialism
Functional & Industry TechnologiesManagement Level
ManagerJob Description & Summary
The Opportunity
Join our Acceleration Center India and help shape the future of business for our diverse client portfolio across geographies and jurisdictions. You’ll work at the heart of global teams across Advisory, Assurance, Tax and Business Services—solving real client challenges through connected collaboration. We’ll help you grow your skills so you can go further. With hands-on learning, cutting-edge tools and an inclusive culture, this is your opportunity to do inspiring work that makes a difference—every day.
As a Data Engineer - Manager, you will play a pivotal role in developing innovative software solutions that drive digital transformation and enhance business performance. Within our Advisory - Other practice, you will leverage your technical skills and creative thinking to design, code, and test applications that revolutionize industries and deliver exceptional user experiences. This role is client-facing, allowing you to directly impact client success through your work.
As a Manager, you will lead teams and manage client accounts, focusing on strategic planning and mentoring junior staff. You are accountable for confirming project success and maintaining standards. Enhancing your leadership style, you motivate, develop, and inspire others to deliver quality. You are responsible for coaching, leveraging team members' unique strengths, and managing performance to deliver on client expectations. With your growing knowledge of how business works, you play an important role in identifying opportunities that contribute to the success of our Firm. You are expected to lead with integrity and authenticity, articulating our purpose and values in a meaningful way. You embrace technology and innovation to enhance your delivery and encourage others to do the same.
In this role at PwC Acceleration Center India, you will have the opportunity to take ownership of projects, confirming their successful planning, budgeting, execution, and completion. You will also have the chance to develop skills outside your comfort zone and encourage others to do the same, fostering a culture of continuous improvement and innovation.
Responsibilities
- Lead the design, development, and deployment of scalable data engineering solutions that drive digital transformation and business value.
- Serve as the technical lead for complex data engineering initiatives, guiding solution design, development, testing, and delivery.
- Design and build scalable data pipelines, data products, and analytics solutions using Python, SQL, Spark, and modern cloud technologies.
- Develop and optimize data engineering solutions on modern cloud data platforms and lakehouse architectures, such as Databricks, Microsoft Fabric, Snowflake, Sigma, or similar enterprise data platforms.
- Drive technical design discussions and architecture reviews to ensure solutions are scalable, maintainable, secure, and performant.
- Build and integrate enterprise applications, APIs, and data services to enable seamless interoperability across platforms and systems.
- Conduct code reviews, establish engineering standards, and promote development best practices to maintain high-quality software solutions.
- Implement and champion CI/CD, DevOps, automated testing, and deployment automation practices to improve engineering productivity and solution reliability.
- Apply data modeling techniques and architectural patterns including data lake, lakehouse, Delta Lake, and data warehouse solutions.
- Design and implement AI-enabled data solutions using Generative AI, Retrieval-Augmented Generation (RAG), semantic search, and intelligent automation capabilities.
- Analyze complex technical challenges, identify system interactions and dependencies, and drive performance optimization and continuous improvement.
- Collaborate closely with product owners, business stakeholders, and engineering teams to translate business requirements into robust technical solutions.
- Mentor engineers through technical leadership, design guidance, code reviews, and knowledge sharing while remaining actively involved in solution delivery.
What You Must Have
- Bachelor’s degree or equivalent experience.
- 9 to 12 years of relevant experience in data engineering or related technology roles.
What Sets You Apart
- Deep expertise in Data Engineering, Solution Design, and Technical Leadership.
- Proven experience delivering complex data engineering solutions using modern cloud data platforms and technologies.
- Strong hands-on experience designing scalable Data Lake, Lakehouse, Data Warehouse, and distributed data processing solutions.
- Expertise in API Management, enterprise application integration, and modern software development practices.
- Advanced experience implementing CI/CD, DevOps, automated testing, and deployment automation frameworks.
- Strong understanding of software architecture, design patterns, system integration, and performance optimization.
- Experience building and deploying Generative AI, Retrieval-Augmented Generation (RAG), semantic search, vector database, and AI-powered data solutions.
- Hands-on experience with agentic AI frameworks such as LangChain, LangGraph, Semantic Kernel, AutoGen, or similar technologies.
- Strong analytical thinking and problem-solving skills with the ability to address complex data engineering and software development challenges.
- Ability to lead technical discussions, influence design decisions, and drive engineering best practices across teams.
- Passion for emerging technologies, continuous learning, and applying AI-driven innovation to solve business problems.
- Demonstrated ability to balance hands-on development, technical leadership, solution quality, and successful delivery outcomes.
Travel Requirements
Up to 20%Job Posting End Date