Senior Data Engineer - 100TB/Day AI Pipelines
Summary
Senior Data Engineer owning end-to-end large-scale ingestion and transformation pipelines processing ~100TB/day for The Hotels Network's Lighthouse product, working with Python, dbt, Airflow, BigQuery, Spanner, Pub/Sub, and Kubernetes on Google Cloud Platform alongside product, engineering, and business teams.
Lighthouse is looking for a Senior Data Engineer to own the end-to-end lifecycle of its large-scale ingestion and transformation engine. You will design, develop, scale, and maintain data pipelines handling massive data streams around 100 TB per day.
You will work with Python, dbt, Airflow on Google Cloud Platform, BigQuery, Spanner, Pub/Sub, Kubernetes, and Claude, collaborating with product, engineering, support, and business teams to deliver high-fidelity data products.