Senior Data Engineer - IC

Major digital and media solutions provider in Hong Kong

Job Description

Candidates with less experience will be considered as Data Engineer.

Responsibilities

• Build up best in class data infrastructure, data engineering solutions.
• Work with cross-functional teams within the organization of different countries, and working with PB size of data, by using modern data technologies (AWS, Databricks, Confluent Kafka, dbt, etc.).
• Leverage industry best practices to build highly flexible, scalable and cost-effective data pipelines and platforms.
• Manage data lakehouse architecture and self-service tools. Ensure that data is highly available and reusable for enabling data science initiatives, analytics and end users to drive business growth.
• Develop efficient clean code, improve existing code for better performance, code review, execute code builds to test and production environments.
• Manage and lead several data projects.

Job Requirements

• To be successful in your new position, it is essential to have the following skills:
• Degree in Computer Science, Information System, Actuarial or related discipline.
• At least 5 years of working experience in data warehouse, ETL, BI, Big data areas and broad exposure to all its sub-disciplines.
• Strong in SQL, Python/Scala.
• Experience working with large, complex and multiple data sets from various sources.
• Expert in data architecture, data modelling and design, data pipeline and data integration.
• Hands‑on experience in using big data components such as Hive, Spark, Presto, Python and Airflow.
• Experience in AWS (EC2, S3, Kinesis/Kafka, Athena, Redshift), Google Cloud or other public cloud environments is a must.
• Experience leading a small team of data engineers is a plus.
• Working experience in the digital, e‑commerce industry, mobile app and web environment is highly desirable.