Senior Data Engineer - Big Data
Summary
Design and build ETL pipelines, transform data from multiple sources, and create dashboards for a government logistics data project using Python, PL/SQL, and visualization tools.
SW8325 |08 Jun 2022 Senior Data Engineer - Big Data
Responsibilities
- Conduct user requirement analysis, ETL design and implementation support for Big Data and Analytic initiatives
- Gather & consolidate data analytics refs for B2B project and align with Council’s data architecture
- Design & develop solutions for data analytics projects according to business requirements
- Implement efficient data pipelines to transform data from multiple data sources (i.e. ETLs)
- Use visualization tools to design and build dynamic dashboards and reports
- Work closely with vendor / in-house Data Scientists and AI development team and facilitate the implementation
Qualifications
- Degree or equivalent qualification in Computer Science, Statistics, Information Management or related disciplines
- 7 years of working experience as a Data Engineer
- Solid programming skills in Python and PL/SQL
- Hands on experience in ETL, Data transformation and Data Modelling
- Familiar with visualization tool, e.g. Tableau, Google Data Studio, Adobe Analytics
- Experience in Cloud platforms would be an added advantage, e.g. AWS Redshift, Google Big Query
- Self-motivated and able to work independently
- Excellent interpersonal, written and verbal communications skills in both English and Chinese
- Required to work in Tseung Kwan O Logistics Centre