車電Senior Data Engineer(內湖) - TWPR01483
Description
1. Design, develop, and maintain ETL / ELT data pipelines, including data ingestion, parsing, transformation, validation, and export.
2. Modularize, standardize, and automate existing script-based or manual processes, and define clear pipeline interfaces, dependencies, and processing flows.
3. Establish monitoring, logging, error handling, retry, failure recovery, and data validation mechanisms to ensure pipeline reliability and data quality.
4. Analyze and optimize data processing performance, reliability, and scalability.
5. Collaborate with Database Engineers and Automation / DevOps Engineers to integrate databases, NAS / file storage, and workflow orchestration platforms.
6. Create and maintain relevant architecture, interface, operation, and troubleshooting documentation.