Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

Willis Towers Watson

Principal Data Engineer – Enterprise Data Products

Posted 47 views

Summary

Hands-on senior IC data engineer at Willis Towers Watson shaping the Enterprise Data Products platform during a technology transformation: designing and building scalable pipelines and lakehouse solutions with Databricks, Spark/PySpark, Python and SQL, while mentoring engineers and guiding technical direction.

Overview

In this Principal Data Engineer role, you will help shape and implement the Enterprise Data Products platform amid a major technology transformation. You’ll work closely with the Technical Lead and distributed engineers to translate architecture into practical, scalable data solutions. You’ll evaluate options, prototype improvements, and drive pragmatic designs while maintaining engineering rigor. This is a high-impact, hands-on senior IC position focused on delivering enterprise-grade data capabilities and guiding technical direction.

Pay / Benefits
  • 25 days of annual leave
  • private healthcare
  • life insurance
  • defined contribution pension with up to 10% company match
  • hybrid working
  • volunteer day
Responsibilities
  • Understand the current platform and transformation roadmap; contribute to implementation and evolution of target architecture
  • Design and implement scalable, maintainable data solutions using Databricks, Spark/PySpark, Python and SQL
  • Develop reusable data ingestion, transformation and delivery patterns
  • Evaluate options balancing scalability, performance, cost; prototype alternatives
  • Identify risks and dependencies early and propose pragmatic mitigations
  • Provide mentorship and technical guidance through reviews, coaching and knowledge sharing
  • Influence engineering decisions and maintain quality through CI/CD, testing and observability
  • Turn high-level requirements into concrete technical approaches and plan increments
Key requirements
  • Deep hands-on Databricks experience across implementation, development, production support and maintenance
  • Significant experience delivering complex enterprise data engineering solutions
  • Strong Python and SQL production-quality Databricks notebooks
  • Knowledge of modern data engineering, distributed processing and lakehouse concepts
  • Experience with Apache Spark or comparable large-scale data tech
  • Cloud-based data platforms and product design experience
  • Data modelling, ingestion, transformation and integration expertise
  • Automated testing, source control and CI/CD experience
  • Troubleshooting and problem-solving capabilities
  • Experience supporting engineers without direct management and contributing to modernization/architecture transformation
  • Technical curiosity
  • pragmatism
  • ability to influence and collaborate across distributed teams
  • Databricks
  • Apache Spark / PySpark
  • Python

Skills

What Principal Data Engineering jobs ask for — and how much of it you have →
Apply

See also

Data Engineering jobs by country — openings, pay and top skills →