Senior Data Engineer
Summary
A 3-month contract Senior Data Engineer role in London building and operating pipelines in Databricks and Airflow that feed daily reporting, attribution, and LTV calculations from ad platforms, payment systems, and product backends. Core stack: Python, SQL, Spark, Databricks (Delta Lake/Unity Catalog), Airflow, and GCP.
Senior Data Engineer
About the Role
We are looking for a motivated Data Engineer to join our Data Platform team and help align reliable marketing, payments, and product data with business goals to drive organizational success.
In this role, you will build and operate the pipelines that feed daily reporting, attribution, and LTV calculations ingesting data from ad platforms, payment systems, and product backends into our lakehouse, orchestrating jobs, and keeping silver/gold tables accurate and on time. You'll work closely with Analytics, Marketing, and Data Science teams to make a meaningful impact on both our products and processes.
Role Details
- Start date: ASAP
- Rate: €250 - €300
- Contract: 3 months
Key Responsibilities
- Build and maintain pipelines that feed daily reporting, attribution, and LTV.
- Ingest data from ad platforms, payment systems, and product backends into Databricks.
- Orchestrate and monitor jobs in Apache Airflow.
- Keep silver/gold tables accurate, tested, and delivered on time.
- Proactively identify, troubleshoot, and resolve issues to optimize internal and external processes.
- Balance multiple projects without sacrificing quality, aligning work with brand standards, cultural nuances, and regulatory requirements.
- Engage with diverse stakeholders (product, engineering, marketing) to gather requirements, evaluate options, and develop tools and processes supporting organizational goals.
- Own production reliability: scheduled jobs, data quality checks, alerting, and getting a failed daily run back on track.
Required Skills & Experience
Technical Skills
- Strong experience with Python and SQL.
- Hands-on experience with Apache Spark.
- Experience with Databricks (Unity Catalog / Delta Lake).
- Experience orchestrating workflows with Apache Airflow.
- Familiarity with GCP services (GCS, BigQuery).
- Experience with dbt and ads/payments APIs (e.g., Google Ads, Stripe, RevenueCat) is a plus.
- Solid understanding of agile methodologies.
Soft Skills
- Excellent analytical and problem-solving abilities, with a strategic approach to challenges.
- Strong collaboration skills for working seamlessly across cross-functional teams.
- Exceptional communication skills for engaging stakeholders at various levels.
- Advanced English proficiency, spoken and written (C1 or equivalent).
- Curiosity about the business behind the data marketing spend, subscriptions, attribution not just the pipelines that move it.