【台北】數據工程師Data Engineer — "Data Infrastructure Architect"
Description
【Job Responsibilities】
1. 專案開發與交付
設計、建置並實作具擴展性的 AWS 數據管道與基礎架構。
與跨部門團隊合作,理解專案需求並確保順利交付。
Develop and Deliver Projects
Design, build, and implement scalable data pipelines and infrastructure on AWS.
Collaborate with cross-functional teams to understand project requirements and
ensure successful delivery.
2. 專案支援
針對專案相關問題進行故障排除,確保系統穩定性與效能。
採用最佳實務,並提出創新解決方案以滿足客戶需求。
Project Troubleshooting and Support
Troubleshoot project-related issues to ensure system stability and performance.
Implement best practices and propose innovative solutions to meet client needs.
3. 數據轉換與整合
設計與實作數據轉換流程(ETL/ELT),將多來源的數據整合至數據倉儲或資料湖。
確保數據準確性與一致性,並優化數據處理效能。
Data Transformation and Integration
Design and implement data transformation processes (ETL/ELT) to integrate data
from multiple sources into data warehouses or data lakes.
Ensure data accuracy and consistency while optimizing data processing performance.
4. 數據監控與報表設計
使用 Tableau 或 Grafana 設計並維護即時監控儀表板,提供可操作的數據洞察。
Data Monitoring and Dashboard Design
Design and maintain real-time monitoring dashboards using Tableau or Grafana to
provide actionable data insights.
5. 自動化與流程優化
使用Airflow開發自動化流程,優化現有數據管道與基礎設施。
Automation and Process Optimization
Develop automated workflows using Airflow to streamline and optimize existing
data pipelines and infrastructure.
【What We’re Looking For】
- 經驗:具備作為 Data Engineer 的相關經驗,尤其是 AWS 服務與工具的實務操作經驗
Experience: Proven experience as a Data Engineer, with hands-on experience in
AWS services and tools.
- 技能:
優秀的問題解決與故障排除能力。
熟練使用 Python、SQL 及相關數據工程工具。
具備良好的溝通與協作能力,能有效與多元團隊及客戶合作。
Skills:
Strong problem-solving and troubleshooting abilities.
Proficiency in Python, SQL, and data engineering tools.
Excellent communication and collaboration skills to work effectively with diverse teams and clients.
- 加分條件
取得 AWS 認證(如 AWS Certified Data Engineer Associate、AWS Certified Solutions Architect)。
具備 GCP 和 Azure 雲端平台的相關經驗。
熟悉 Tableau 和 Grafana 等商業智能與警報工具。
Bonus Points
AWS certifications (e.g., AWS Certified Data Engineer Associate, AWS Certified Solutions Architect).
Experience with GCP and Azure cloud platforms.
Familiarity with BI and alerting tools like Tableau and Grafana.