Research Scientist
Pluralis Research works on Protocol Learning — training large models in a fully decentralised way on small consumer-grade devices connected via the internet. Despite being dismissed as infeasible, we have made significant advances on this problem , most recently training an 8B llama model from scratch with devices in physically different regions. While many of the core research problems have been solved, Protocol Learning unlocks a series of new challenges. If you want your work to shape the fu…