Data Engineer
Summary
Builds and maintains large-scale data pipelines for blockchain chains, developing batch/streaming infrastructure, optimizing storage, creating indexing services, implementing reputation algorithms, and exposing via APIs. Core technologies include data pipelines, SQL/NoSQL, Go/Python/Rust/JS/TS, smart contracts, and AWS/GCP.
You build and maintain large-scale data pipelines that ingest, index, process, and serve data from different chains. You develop batch and streaming infrastructure, optimize storage and database structures, create indexing services, implement reputation algorithms, and expose results through APIs.
Responsibilities
- Build and maintain large-scale data pipelines
- Ingest, index, process, and serve large amounts of data
- Transform data streams into optimized storage solutions
- Develop scalable indexing services for compute clusters
- Implement distributed algorithms for recommendation and reputation scores
- Develop external APIs for third-party applications
Requirements
- 4+ years of experience in software development
- Experience with SQL or NoSQL database technologies
- Ability to design and improve database schemas or key structures for complex query patterns
- Proficiency in two or more of Go, Python, Rust, and JavaScript/TypeScript
- Proficiency in Rust or Go preferred
- Experience with smart contract development
- Experience with AWS or Google Cloud infrastructure services
- Open-source project experience preferred
Benefits
- Equity or tokens
- Medical, dental, and vision health benefits
- Monthly team events
- Quarterly team offsite
- Part-time or full-time work options
- Flexible work environment
- Remote work