Senior Data Engineer
Posted Updated 11
views 1 applied
Summary
Build and own data lake/warehouse architecture, ELT pipelines, and data QA systems, integrating LLM workflows and vector databases using Python, SQL, and Apache Airflow.
- Build Apache Airflow DAGs
- Build automated data QA systems
- Build data infrastructure
- Build vector database features
- Design data models
- Design database schemas
- Develop reusable Python packages
- Implement data pipelines
- Implement data quality checks
- Integrate LLM workflows into ELT pipelines
- Mentor data engineers through code reviews
- Monitor pipelines and resolve incidents
- Optimize SQL queries
- Own data lake and warehouse architecture
Perks/Benefits:
- Equity upside
- Optional retreats
- Remote work
- Work from anywhere