資訊處-資料湖倉 / 資料治理工程師IT Division – Data Lakehouse & Data Governance Engineer
Posted Updated 5
views
Description
1. 湖倉（Lakehouse）與資料平台工程
- 參與 資料湖倉（Lakehouse）架構規劃與建置，整合地端與雲端資料平台
- 建構並維運結構化 / 半結構化 / 非結構化資料之儲存、轉換與查詢機制
- 規劃與實作資料管道（Batch / CDC / Streaming），確保資料即時性與一致性
2.資料治理工程落地
- 參與 資料治理框架落實
- 建置與維護：
o 資料目錄（Data Catalog）
o 元資料管理（Metadata）
o 資料血緣（Lineage）
o 資料品質檢核（DQ Rules）
- 協助資料定義、欄位標準、異動影響分析之技術落地
- 配合稽核、法遵需求，確保資料可追溯、可盤點、可稽核
3.跨部門協作與平台推動
- 與資料治理單位、業務單位、資安單位協作，將治理需求轉為技術實作
- 協助建立 資料生命週期管理（建立、使用、變更、下架）
- 撰寫平台與治理相關技術文件、SOP、交接文件
二、必要條件
- 具 資料工程 / 平台工程實務經驗（3 年以上尤佳）
- 熟悉至少一種資料湖／湖倉技術或概念
（如：Data Lake、Lakehouse、或相近架構）
- 熟悉 SQL，了解資料模型設計（事實表 / 維度表、寬表等）
- 了解資料治理基本概念： 資料目錄、元資料、血緣、品質、資料分級
1. Data Lakehouse & Data Platform Engineering
- Participate in the design, implementation, and enhancement of Data Lakehouse architectures, integrating on-premises and cloud-based data platforms.
- Build and maintain storage, transformation, and query capabilities for structured, semi-structured, and unstructured data.
- Design and implement data pipelines (Batch, CDC, and Streaming) to ensure data timeliness, consistency, and reliability.
- Optimize data platform performance, scalability, and operational efficiency.
2. Data Governance Implementation
- Support the implementation and operationalization of the enterprise data governance framework.
- Develop and maintain:
o Data Catalogs
o Metadata Management repositories
o Data Lineage tracking capabilities
o Data Quality (DQ) monitoring rules and controls
- Facilitate the technical implementation of data standards, business glossaries, data definitions, and impact analysis processes.
- Ensure data assets remain traceable, auditable, and compliant with regulatory, compliance, and audit requirements.
3. Cross-Functional Collaboration & Platform Enablement
- Collaborate with data governance teams, business stakeholders, and information security teams to translate governance requirements into technical solutions.
- Support the establishment and management of enterprise data lifecycle processes, including data creation, usage, modification, retention, and retirement.
- Prepare and maintain technical documentation, standard operating procedures (SOPs), and knowledge transfer materials related to the data platform and governance initiatives.
- Promote data governance best practices and support enterprise-wide data management initiatives.