Data Engineer (Content Processing)
Posted 5
views
Summary
The Data Engineer will architect high-throughput pipelines for unstructured data, focusing on vector embeddings, hybrid search indexing, and computer vision solutions. The role involves collaborating with cross-functional teams to ensure data quality and system reliability.
- Apply testing and system observability best practices
- Architect high throughput data pipelines for unstructured data
- Build vector embeddings generation pipelines
- Collaborate with frontend engineers data scientists and product managers
- Develop hybrid keyword and vector search indexes
- Engineer computer vision solutions for image and video analysis
- Ensure data quality and pipeline reliability
- Implement data transformation and enrichment for retrieval
Perks/Benefits:
- Mission-driven work
- Opportunities for professional growth
- Work-life balance