Data Engineer

As our first Data Engineer, you will own the data infrastructure that makes this possible. You'll build the pipelines that collect, process, and serve these signals into our real-time ranking system. This is a foundational hire. The entire recommendation engine, from Deal Quality Scores to seasonal trends, depends on the pipelines you build.

Responsibilities:

• Own external data pipelines for Flipkart/Amazon bestseller rankings, PriceHunt/Smartprix for price benchmarking, and Google Trends API for brand and category demand signals.
• Build the Deal Quality Score pipeline, a daily batch job that computes a competitiveness score for every product in our catalogue, stored in Redis for sub-millisecond lookup at serving time.
• Maintain a seasonal and festive calendar, structured data store for trend overlays (IPL, Diwali, back-to-school, etc. )
• Design and own the in-store event schema in ClickHouse that will power behavioural cohorts as in-app data accumulates.
• Build ETL infrastructure (S3 + Spark/Glue) for longer-horizon trend and market data.
• Own data quality and freshness SLAs. You are responsible when a signal the reco engine depends on breaks silently.

Requirements:

• 3-5 years of data engineering experience, ideally at a startup or product company.
• Strong Python. You write clean, production-grade pipeline code, not just notebooks.
• Experience building and maintaining web scrapers or data collection pipelines at scale.
• Hands-on experience with a workflow orchestrator, Airflow, Prefect, or equivalent.
• Solid SQL experience with ClickHouse or another OLAP database is a strong plus.
• Familiarity with Redis as a serving layer, you understand TTL, key design, and cache invalidation.
• Comfortable with AWS S3 Glue and ECS, you can set up infrastructure without needing DevOps help.
• You care about data quality, you monitor pipelines, set up alerts, and feel responsible when something breaks.