Data Engineer
This role involves executing end-to-end incident management for data-related production issues, monitoring daily operation of data pipelines, system interfaces, ETL/ELT processes, and identifying data quality anomalies and platform performance issues. You will handle high-priority BAU data incidents, participate in data migration projects, and support enterprise data governance work.
Key responsibilities
Execute end-to-end incident management for data-related production issues, follow standardized processes to track and resolve data faults
Monitor daily operation of data pipelines, system interfaces, ETL/ELT processes, identify data quality anomalies and platform performance issues
Handle daily high-priority BAU data incidents, elevate complex critical incidents to supervisors in a timely manner with complete problem details
Participate in root cause analysis (RCA) and assist in formulating preventive action plans to avoid recurring problems
Collaborate closely with Data Custodians, business users, application support teams and vendors to troubleshoot and fix daily data issues efficiently
Participate in data migration projects, responsible for specific execution work including data extraction, transformation, validation, data reconciliation and project cutover
Execute data validation and reconciliation work during migration to guarantee data integrity and accuracy
Implement daily data monitoring and control work, timely identify and fix potential data risks and recurring data problems
Maintain and update operational documents, operation manuals, support processes and team knowledge base regularly
Cooperate with data owners and data custodians to optimize data quality, data lineage and data stewardship related processes
About you
Bachelor's Degree or above in Computer Science, Information Technology, Data Engineering, Data Science, Business Analytics, or a related discipline
3-5 years of working experience in Data Engineering, Data Operations, Production Support, Data Warehousing, or Enterprise Data Management
Solid analytical thinking, problem-solving and independent judgment skills, able to efficiently handle daily data operation and fault problems
Practical experience in supporting mission-critical data production environments and participating in end-to-end data incident management processes
Hands-on experience in participating in data migration, data transformation and enterprise data integration projects
Proficient in SQL with solid database query optimization and troubleshooting capabilities
Hands-on experience with enterprise data platforms and mainstream cloud data technologies
Practical working experience with mainstream ETL/ELT tools and data integration frameworks
Fluency in both English and Mandarin/Cantonese (written and spoken)
Good cross-departmental communication and stakeholder collaboration skills, able to cooperate with different teams to complete data work