Senior/Expert Site Reliability Engineer - Big Data Responsibilities
SHOPEE SINGAPORE PRIVATE LIMITED Senior/Expert Site Reliability Engineer - Big Data Responsibilities
Summary
Site Reliability Engineer at Shopee focused on big data platforms: deploying and operating Hadoop-ecosystem services (HDFS, YARN, Spark, Flink, Kafka, ClickHouse, etc.), handling monitoring, incident response, performance tuning, capacity planning, observability, and automation/tooling to keep production reliable.
The Engineering and Technology team is at the core of the Shopee platform development. The team is made up of a group of passionate engineers from all over the world, striving to build the best systems with the most suitable technologies. Our engineers do not merely solve problems at hand; We build foundations for a long-lasting future. We don't limit ourselves on what we can or can't do; we take matters into our own hands even if it means drilling down to the bottom layer of the computing platform. Shopee's hyper-growing business scale has transformed most "innocent" problems into huge technical challenges, and there is no better place to experience it first-hand if you love technologies as much as we do.
Job Description:
- Deploy, operate, and maintain big data platforms, continuously improving their availability, reliability, scalability, and operational efficiency.
- Own monitoring, alerting, incident response, troubleshooting, performance optimization, and capacity planning for big data services and platforms.
- Build and improve platform observability capabilities, including metrics, logging, tracing, dashboards, and alert management.
- Turn operational knowledge and repetitive tasks into documentation, tools, automation, and standardized processes.
- Establish and continuously improve incident response procedures, contingency plans, and post-incident review practices to reduce failure rates and mean time to recovery.
- Collaborate with engineering, data, and infrastructure teams to optimize platform architecture and ensure production reliability and operational safety.
Requirements:
- Bachelor’s degree or higher in Computer Science, Software Engineering, or any related fields.
- At least one year of experience in big data SRE, platform operations, or production support.
- Familiarity with the Hadoop ecosystem and hands-on operational experience with one or more technologies such as HDFS, YARN, Spark, Flink, Hive, Presto/Trino, Kafka, HBase, or ClickHouse.
- Solid knowledge of Linux systems and common operations tools, with practical experience in monitoring, troubleshooting, performance tuning, and capacity planning.
- Hands-on experience handling production incidents in big data environments, with a structured troubleshooting approach and the ability to identify root causes quickly.
- Proficiency in at least one programming or scripting language, such as Shell, Python, Java, or Scala, with the ability to develop operational tools and automation.
- Understanding of high availability, disaster recovery, observability, change management, and Site Reliability Engineering practices.
- Strong communication, collaboration, and cross-functional coordination skills, with a proactive mindset and a commitment to continuous improvement.