【研究發展處】Big Data Engineer 資料工程師 / Senior Big Data Engineer 資深資料工程師

現觀科技發展產品 CovMo近20年作為橫跨美洲、歐洲、亞洲、中東等跨國22間巨頭電信企業專用之 SaaS Solution，功能包含用戶定位及手機網路訊號分析，而 Big Data Team專職於 OLAP維運及效能調教，SQL Tuning、Dashboard Visualization，並與產品開發團隊進行資料探勘及研究。

[工作內容]
1.開發大數據系統資料處理平台
2.串流資料平行處理程序開發,熟悉分散式運算,平行運算
3.解決大量資料處理時所衍生的效能,擴充與維護維運資料庫
•使用Clickhouse、MySQL/MariaDB
4.具有大數據資料解析程式開發能力

• 會有大量的Database Report，需要用SQL/Bash及Python產生
• 使用Grafana做產品資料視覺化

5.與其他系統開發工作團隊配合
6.能獨立作業,抗壓性高

[JOB DESCRIPTION]:

• Maintain and optimize Clickhouse/MySQL databases performance.
• Integrate datasets to provide business insight through SQL process and real-time dashboard.
• Standardize the process of data collection, storage, transformation, distribution, and usage.
• Coordinate with other department to utilize potential data asset towards business strategy.
• Redesign DB architecture for a thousand billions data maintenance.
• Develop stored proc to generate database reports.
• Maintain developed MapReduce system in MySQL database.
• Research a new approach to improve data pipeline.

[QUALIFICATIONS]:

• Knowledge of database installation process
• Experience with CentOS / Ubuntu packaging
• Knowledge of relevant database clients
• Knowledge of mapReduce
• Knowledge or experience of working basic OS and Networking database related issues.
• Knowledge/experience in administration and troubleshooting for one or more of the following:
• Experience performing basic optimization of database
• Have an understanding of database migrations

[WORKING AT BIG DATA TEAM]:

• Experience with data mining, database management and flow control.
• Do something meaningful; Be a part of the future of telecom technology.
• Work with international colleagues.
• Great career development opportunities in a growing company.

#保14