Data Engineer大数据工程师
- Build automated data quality diagnosis
- Build multi source batch and streaming pipelines
- Create observability for data pipelines
- Develop layered data models
- Implement data quality tests and alerting
- Implement dbt models for analytics
- Improve CI workflows and documentation
- Optimize AWS Glue performance and cost
- Optimize ClickHouse performance and cost
- Optimize Spark performance and cost
- Perform anomaly root cause analysis
- Scale lakehouse architecture
- Search and answer data asset questions using AI
- Standardize unified business metrics