高雄軟體園區-資料平台開發工程師/資料工程
Description
團隊組成 (Team):
前身是提供企業內部資料分析顧問服務以及打造客製化資料系統服務團隊之資料工程部門,擁有多年經驗。目前積極規畫與開發自有的資料處理平台,支撐高自由度、高效能、可靠並可擴展之資料處理/分析流程,解決實務上欲打造一套資料系統的難題。
工作內容 (Responsibilities):
1. Software Engineering:
- Produce specifications and determine operational feasibility
- Write well-designed and testable code for building an efficient and stable system
- Troubleshoot, debug, maintain, and upgrade existing systems
2. Data Platform Development & Data Engineering:
- Module development and integration for building a modern data platform
- Efficient data flow/pipeline module design and Implementation
- Work closely with data science team to integrate ML/statistical models and analytical workflow
資格 (Qualifications):
- Proficient in Python/R and related data processing packages
- Proven experience in developing data pipeline, data processing workflow, or data analytics system
- Master in database (RDB or NoSQL) design and operation
- Ability to document requirements and specifications
- (Plus) Have experience working with Apache NiFi and Hadoop ecosystem (e.g., Hive, HBase, Spark, Kafka)
- (Plus) Have experience in data mining and machine learning
- (Plus) Have experience in system/database performance tuning
認真負責 配合度高