Big Data Engineer, TikTok Ecommerce Recommendation Infrastructure
Posted
Summary
Big Data Engineer on TikTok Shop's E-commerce Recommendation Infrastructure team in Singapore, designing offline data architectures and scalable, high-availability storage/computing systems for large-scale recommendation pipelines, using big-data frameworks like Hadoop, Flink, Spark, and Kafka.
About TikTok
TikTok is the leading destination for short-form mobile video. At TikTok, our mission is to inspire creativity and bring joy. TikTok's global headquarters are in Los Angeles and Singapore, and we also have offices in New York City, London, Dublin, Paris, Berlin, Dubai, Jakarta, Seoul, and Tokyo.
Why Join Us Inspiring creativity is at the core of TikTok's mission. Our innovative product is built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and bring joy - a mission we work towards every day.
We strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. Every challenge is an opportunity to learn and innovate as one team. We're resilient and embrace challenges as they come. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our company, and our users. When we create and grow together, the possibilities are limitless. Join us.
Diversity & Inclusion TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.
Job highlights
Positive team atmosphere
Career growth opportunity
Paid leave
Responsibilities About the Team E-commerce is a new and fast growing business that aims at connecting all customers to excellent sellers and quality products on TikTok Shop, through E-commerce live-streaming, E-commerce short videos, and commodity recommendation. Our E-ecommerce Recommendation Infra team is responsible for building up and optimizing the infrastructure for such recommendation systems, so as to provide the most stable and best experience for our users. We work closely with applied machine learning engineers and build scalable systems to support all kinds of innovative algorithms and techniques.
The team is responsible for system stability and high availability, online services and offline data flow performance optimization, solving system bottlenecks, reducing cost overhead, building data and service mid-platform, realizing flexible and scalable high-performance storage and computing systems.
Responsibilities
Design and implement a reasonable offline data architecture for large-scale recommendation systems
Design and implement flexible, scalable, stable and high-performance storage and computing systems
Trouble-shooting of the production system, design and implement the necessary mechanisms and tools to ensure the stability of the overall operation of the production system
Build industry-leading distributed systems such as storage and computing to provide reliable infrastructure for massive data and large-scale business systems
Develop and implement techniques and analytics applications to transform raw data into meaningful information using data-oriented programming languages and visualisation software
Apply data mining, data modelling, natural language processing, and machine learning to extract and analyse information from large structured and unstructured datasets
Visualise, interpret, and report data findings and may create dynamic data reports as well
Qualifications Minimum Qualifications
Bachelor's degree or above in computer science, software engineering, or a related field
Familiar with many open source frameworks in the field of big data, e.g.Hadoop, Hive,Flink, FlinkSQL,Spark, Kafka, HBase, Redis, RocksDB, ElasticSearch etc.
Familiar with Java, C ++ and other programming languages
Strong coding and trouble shooting ability
Why Join Us Inspiring creativity is at the core of TikTok's mission. Our innovative product is built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and bring joy - a mission we work towards every day.
We strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. Every challenge is an opportunity to learn and innovate as one team. We're resilient and embrace challenges as they come. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our company, and our users. When we create and grow together, the possibilities are limitless. Join us.
Diversity & Inclusion TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.
Job highlights
Positive team atmosphere
Career growth opportunity
Paid leave
Responsibilities About the Team E-commerce is a new and fast growing business that aims at connecting all customers to excellent sellers and quality products on TikTok Shop, through E-commerce live-streaming, E-commerce short videos, and commodity recommendation. Our E-ecommerce Recommendation Infra team is responsible for building up and optimizing the infrastructure for such recommendation systems, so as to provide the most stable and best experience for our users. We work closely with applied machine learning engineers and build scalable systems to support all kinds of innovative algorithms and techniques.
The team is responsible for system stability and high availability, online services and offline data flow performance optimization, solving system bottlenecks, reducing cost overhead, building data and service mid-platform, realizing flexible and scalable high-performance storage and computing systems.
Responsibilities
Design and implement a reasonable offline data architecture for large-scale recommendation systems
Design and implement flexible, scalable, stable and high-performance storage and computing systems
Trouble-shooting of the production system, design and implement the necessary mechanisms and tools to ensure the stability of the overall operation of the production system
Build industry-leading distributed systems such as storage and computing to provide reliable infrastructure for massive data and large-scale business systems
Develop and implement techniques and analytics applications to transform raw data into meaningful information using data-oriented programming languages and visualisation software
Apply data mining, data modelling, natural language processing, and machine learning to extract and analyse information from large structured and unstructured datasets
Visualise, interpret, and report data findings and may create dynamic data reports as well
Qualifications Minimum Qualifications
Bachelor's degree or above in computer science, software engineering, or a related field
Familiar with many open source frameworks in the field of big data, e.g.Hadoop, Hive,Flink, FlinkSQL,Spark, Kafka, HBase, Redis, RocksDB, ElasticSearch etc.
Familiar with Java, C ++ and other programming languages
Strong coding and trouble shooting ability