Database & Infrastructure Engineer (Full Stack)
You will make our data layer world-class by optimizing and scaling PostgreSQL infrastructure that processes millions of files per day and stores hundreds of millions of media records. You'll design indexing, partitioning, and query strategies for large-scale media datasets, and improve performance across ingestion, enrichment, and retrieval pipelines. You'll build internal tools for querying and auditing large datasets, create customer-ready dataset sample packs, and design and automate dataset exports and delivery pipelines using S3, secure transfers, and custom formats. You'll work across backend, ML, and product teams to support new features. This isn't just DBA work — you'll help design the systems that move and package the data powering frontier AI labs.
Responsibilities
- Optimize and scale PostgreSQL (Supabase) infrastructure
- Design indexing, partitioning, and query strategies for large-scale media datasets
- Improve performance across ingestion, enrichment, and retrieval pipelines
- Build internal tools for querying and auditing large datasets
- Create customer-ready dataset sample packs
- Design and automate dataset exports and delivery pipelines (S3, secure transfers, custom formats)
- Work across backend, ML, and product teams to support new features
Requirements
- Strong PostgreSQL expertise (indexing, partitioning, performance tuning)
- Experience working with large datasets (100M+ records preferred)
- Deep understanding of storage systems (S3 or similar object storage)
- Strong backend experience (TypeScript, Python, or similar)
- Comfort building internal tooling and automation scripts
- Ability to move between database, backend, and infrastructure work
- Experience with data pipelines (ETL, transformation layers) - bonus
- Experience with vector databases (pgvector, FAISS, Pinecone) - bonus
- Experience delivering structured datasets to enterprise customers - bonus
- DevOps experience (CI/CD, infra automation) - bonus
- Experience working with media-heavy systems - bonus