数据管线高级工程师
- Build data cleaning labeling quality tools
- Build distributed data lakehouse management platform
- Build high throughput low latency distributed systems
- Build offline and real time processing
- Collaborate with machine learning teams to deliver data for model iteration
- Create data visualizations
- Design data models
- Design data pipeline end to end
- Develop data mining tools
- Enable data lineage tracking
- Implement data collection and synchronization
- Implement data version control
- Implement streaming data pipelines
- Manage metadata and fast search
- Optimize distributed data processing performance
- Perform data cleaning and standardization
- Provide data services