Huawei Hong Kong Research Center(HKRC)
Open positions
1 job
LLM KV Cache Systems Engineer
New 4 days ago35 views
Hong Kong SAR China
Tai Po District, Hong Kong SARSystems engineer designing and building KV Cache subsystems for LLM inference: memory allocators, compression, transfer (RDMA/NVLink), GPU/CPU/SSD tiering, and KV-aware scheduling in distributed serving systems like vLLM and SGLang. Core stack: C++, Python, CUDA, Linux.
API C++ CUDA Distributed Systems GPU +9 skills