Site Reliability Engineer, Data Infrastructure
Summary
Maintains and optimizes Shopee’s big-data stack (Hadoop, Spark, Kafka) to keep data pipelines stable, efficient, and scalable for analytics and machine-learning workloads.
About The Team
Shopee will be prioritizing applicants who have a
current right to work in Singapore , and
do not require Shopee sponsorship of a visa .
Kindly note that you can only be considered in
one recruitment process at a time within Sea Group
and will be considered for jobs in the order that you have applied.
The Data Infrastructure team is responsible for building a stable, efficient, secure, and easy-to-use big data infrastructure and platform for the company. Committed to providing the company's various business teams and data teams, data analysts, machine learning teams, BI teams, etc. with its data-efficient and stable data storage, calculation, query, and analysis of the big data basic system; development and production platform, and data analysis platform.
Including data collection, storage, offline calculation of massive data, real-time stream computing, online analysis and processing, instant return query, and other aspects of data infrastructure support, as well as big data development, production scheduling, data quality monitoring, data maps, and other platform services. Provide the upper-level business team and data team with a basic platform for various technical directions such as computing scheduling, batch computing, real-time computing, structured data query, big data analysis, and KV query. Help business teams build data reports, data monitoring dashboards, real-time business data processing, data mining, and analysis, etc.
Job Description
Responsible for maintaining big data system such as Hadoop/Spark/Storm/Kafka. Responsible for big data ops architecture review, capacity planning, cost optimisation, tracking and troubleshooting, and building a big data monitoring system to maintain overall stability and efficiency. Deeply participate in big data related businesses, such as search engine, deep learning, and promote the sustainable development of big data business. Responsible for the maintenance and development of the BigData ops automation platform, and improve the operation and maintenance management level of big data.
Requirements
Bachelor's or higher degree in Computer Science, Engineering, Information Systems or related fields. Familiar with the linux system and script developments, familiar with the common python/Shell background development. Familiar with BigData platform such as Hadoop/zookeeper/redis/kafka/SPARK/MQ/ELK will be a plus. Familiar with large-scale big data operation and maintenance architecture solutions will be a plus. Excellent communication, expression and organizational collaboration teamwork ability, adapt to a diversified international working environment.
Shopee will be prioritizing applicants who have a
current right to work in Singapore , and
do not require Shopee sponsorship of a visa .
Kindly note that you can only be considered in
one recruitment process at a time within Sea Group
and will be considered for jobs in the order that you have applied.
The Data Infrastructure team is responsible for building a stable, efficient, secure, and easy-to-use big data infrastructure and platform for the company. Committed to providing the company's various business teams and data teams, data analysts, machine learning teams, BI teams, etc. with its data-efficient and stable data storage, calculation, query, and analysis of the big data basic system; development and production platform, and data analysis platform.
Including data collection, storage, offline calculation of massive data, real-time stream computing, online analysis and processing, instant return query, and other aspects of data infrastructure support, as well as big data development, production scheduling, data quality monitoring, data maps, and other platform services. Provide the upper-level business team and data team with a basic platform for various technical directions such as computing scheduling, batch computing, real-time computing, structured data query, big data analysis, and KV query. Help business teams build data reports, data monitoring dashboards, real-time business data processing, data mining, and analysis, etc.
Job Description
Responsible for maintaining big data system such as Hadoop/Spark/Storm/Kafka. Responsible for big data ops architecture review, capacity planning, cost optimisation, tracking and troubleshooting, and building a big data monitoring system to maintain overall stability and efficiency. Deeply participate in big data related businesses, such as search engine, deep learning, and promote the sustainable development of big data business. Responsible for the maintenance and development of the BigData ops automation platform, and improve the operation and maintenance management level of big data.
Requirements
Bachelor's or higher degree in Computer Science, Engineering, Information Systems or related fields. Familiar with the linux system and script developments, familiar with the common python/Shell background development. Familiar with BigData platform such as Hadoop/zookeeper/redis/kafka/SPARK/MQ/ELK will be a plus. Familiar with large-scale big data operation and maintenance architecture solutions will be a plus. Excellent communication, expression and organizational collaboration teamwork ability, adapt to a diversified international working environment.