Data Engineer
Summary
Builds and maintains ETL pipelines and data warehouses for gaming products, using Hadoop, Spark, Flink, and SQL to process real-time and offline data.
Job Responsibilities:
Work with multiple games, responsible for offline/real-time ETL tasks across various business lines
Responsible for integration and modeling of data warehouse systems, including maintenance and optimization
Design and implement ETL for data models, participate in optimization of team ETL processes and solve technical issues
Design and manage data quality monitoring and governance of the data warehouse.
Job Requirements:
Bachelor's degree or above, mathematics, statistics, or computer-related majors preferred
Over 4 years of experience in database development
Familiar with mainstream data processing frameworks and technologies such as Hadoop, Hive, Flink, Spark, Hudi, and proficient in at least two of them
Proficient in at least one programming language such as Java, Scala, or Python. Proficient in database technologies and SQL
Detail-oriented, data-sensitive, strong in logical thinking, good team player with communication skills
Experience with AWS or Alibaba Cloud big data components is prefered