Principal Engineer (Data)
Posted Updated
Description
- We are looking for a Principal Engineer – Data to shape the technical direction and evolution of the data ecosystem supporting our consumer products and business capabilities
- As a senior technical leader, you will define architectural direction, establish engineering standards, influence technology decisions across teams, and mentor engineers while remaining hands-on in the design, development, and operation of critical data systems
- This role requires broad technical expertise across the data ecosystem, including event collection, streaming, data processing, transformation, modeling, governance, trusted metrics, and AI-enabled analytics
- You will work closely with engineering, product, analytics, privacy, and business stakeholders to translate complex requirements into scalable, reliable, secure, and cost-effective data capabilities
- Success in this role means building and evolving a data ecosystem that is reliable, understandable, governed, compliant, and accessible, enabling trusted decisions across product, content, audience, subscriptions, and advertising
- Define and drive the technical direction of our data ecosystem, establishing scalable, resilient, and maintainable architectural patterns across data engineering teams
- Lead the design and evolution of data solutions built on Databricks and related technologies, making informed tradeoffs across performance, reliability, scalability, maintainability, and cost
- Provide architectural guidance across the data lifecycle, including event collection, ingestion, streaming, transformation, storage, modeling, and consumption
- Identify systemic technical challenges, evaluate emerging technologies, and drive architectural improvements that support long-term business and engineering objectives
- Establish engineering standards, reusable patterns, and technical best practices that improve consistency, development efficiency, and operational excellence
- Remain actively involved in data engineering delivery, writing and reviewing production SQL, Python, PySpark, and dbt code, prototyping solutions, and helping resolve complex technical challenges
- Drive data engineering excellence through robust data contracts, schema evolution practices, automated testing, lineage, and observability
- Leverage Monte Carlo and related capabilities to improve data reliability, detect issues proactively, assess downstream impact, and implement sustainable solutions
- Guide performance optimization, resource utilization, and cost-efficiency initiatives across data processing and storage workloads
- Promote operational excellence through monitoring, incident response, root cause analysis, and continuous improvement of critical data systems
- Guide the design of scalable data models, including dimensional modeling and reusable data products that support analytics, reporting, and operational use cases
- Establish consistent, governed KPI definitions and trusted datasets that enable reliable measurement of audience, engagement, conversion, retention, and other business outcomes
- Define and promote engineering practices for handling personally identifiable information (PII), including classification, access controls, consent-aware processing, retention, and deletion
- Partner with Privacy, Security, and Governance teams to embed compliance and data protection requirements into architectural decisions and engineering practices
- Drive improvements in consumer data quality, identity resolution, and cross-channel measurement capabilities
- Advance the responsible adoption of AI technologies, including LLMs, agents, and Databricks Genie, to improve data discovery, engineering productivity, and self-service analytics
- Help establish trusted, well-governed data foundations that support AI-enabled products and analytical experiences
- Promote an AI-driven development lifecycle (AI-DLC), identifying opportunities to accelerate engineering delivery while maintaining appropriate standards for quality, security, and human oversight
- Evaluate emerging AI capabilities and their potential application to data engineering, analytics, and platform operations
- Serve as a trusted technical advisor across engineering, product, analytics, and business teams, translating complex technical decisions into clear recommendations and business implications
- Lead architectural discussions, facilitate design reviews, and build alignment on technical approaches across teams without relying on direct reporting authority
- Mentor senior data engineers, strengthen technical capabilities across teams located globally, and foster a culture of engineering excellence, knowledge sharing, and continuous improvement
- Balance immediate delivery needs with long-term architectural sustainability, helping teams make pragmatic decisions that support business priorities
Benefits
- Domestic Partner Benefit Extensions
- Free Mental Health Services
- Assistance in Refinancing Student Loans
- Long-term Remote Work Pilot
- Extended Bereavement leave
- Extended Parental Leave
- Added Adoption Financial Support
- Extensive production experience with Databricks, PySpark, SQL, Python, and dbt, including the development and optimization of batch and streaming data pipelines
- Proven Principal-level technical leadership, including defining architectural direction, influencing multiple teams, driving technical alignment, and delivering complex engineering initiatives
- Strong understanding of consumer data challenges, including identity resolution, event quality, privacy, consent, and cross-channel measurement
- Strong architectural expertise across modern data ecosystems, including ingestion, event-driven systems, distributed processing, transformation, modeling, and data consumption
- Experience designing Kafka-based or comparable event-driven architectures and working with event tracking platforms such as Snowplow, RudderStack, or Segment
- Ability to communicate architectural tradeoffs effectively to both technical and non-technical stakeholders, connecting engineering decisions to business outcomes
- Proven experience implementing data governance and privacy controls, including PII protection, access management, data retention, and secure data processing
- Practical experience applying LLMs, AI agents, or AI-assisted development practices to engineering or analytical workflows, with an understanding of evaluation, governance, and human oversight
- Demonstrated ability to improve data reliability through automated testing, monitoring, observability, incident management, and clear ownership of critical datasets
- Strong command of dimensional modeling and the ability to translate ambiguous business requirements into well-defined, reusable datasets, metrics, and data products
- Deep, hands-on experience designing, building, and operating large-scale consumer data platforms, including high-volume behavioral or transactional data
- Advertising: Models for ad inventory, placements, campaigns, impressions, viewability, clicks, and revenue
- Consumer identity and lifecycle: Models that connect anonymous activity, registration, and subscription status across devices while respecting consent and keeping PII appropriately protected
- Shared metrics: Curated models and definitions for reach, active audience, engagement, conversion, retention, and revenue that remain consistent across brands and platforms
- Content and consumption: Dimensions for articles, authors, topics, brands, and content formats; fact tables for page or screen views, sessions, video plays, and content engagement. Measures may include engaged time, scroll depth, recirculation, and completion
- You should be able to explain data models you have built for comparable consumer journeys and how you would apply them to a digital publishing business. Examples include:
- Acquisition and subscriptions: Models for referral sources and campaigns, registration and paywall funnels, subscription starts, renewals, cancellations, and retention
- Experience in digital publishing, media, or other consumer-facing industries, including audience development, content performance, subscriptions, or advertising measurement
- Experience establishing semantic layers, self-service analytics capabilities, or shared metric definitions across multiple teams
- Experience defining technical strategies or leading architectural transformations across large-scale data platforms
- Experience improving data platform cost efficiency, performance, and operational scalability
Skills
Sign in to read and join the discussion.