Pluralis Research

@Pluralis

Pluralis is a research lab focused on collectively-owned AI.

pluralis.ai

Joined July 2024

Pinned
Pluralis Research
@Pluralis
May 20
Today we're releasing Agora: the first ever pretraining stack that allows non-collocated consumer GPUs to be competitive with centralized clusters Agora is 15x faster than Megatron-LM in this setting and is only 1.5x less efficient in terms of tokens per unit compute than
Pluralis Research
@Pluralis
12h
Our founder @AlexanderLong at @StanfordSBA with @jbrukh of @coinfund, discussing whether decentralized training can match datacenter training speed and how we can ensure the future of models remains open and accessible to everyone.
Stanford Blockchain Accelerator (SBA)
@StanfordSBA
Aug 7
@AlexanderLong of @Pluralis in conversation with @jbrukh of @coinfund on whether decentralized training can actually perform 👇 youtube.com/watch?v=WRpf1h…
Pluralis Research
@Pluralis
Jul 16
60 page tech report detailing Agora and the run it just powered now on Arxiv. Spans many different fields, from communication-efficient model parallelism, asynchronous optimization, to fault-tolerant systems design.
Pluralis Research
@Pluralis
Jul 15
RL post-training on Macs 14 Macs across 4 countries generate every rollout for the run. Everything's running over the internet. No wire between any of them. As far as we can tell, this is the first RL post-training run with its whole rollout fleet on consumer Macs.
00:00
Pluralis Research
@Pluralis
Jul 11
The cheat sheet for our Protocol Learning workshop, brought to you by Pluralis Research Scientist @hmdolatabadi Videos coming soon!
Hadi M. Dolatabadi
@hmdolatabadi
Jul 11
We had an amazing time yesterday at the Protocol Learning Workshop at #ICML2026 in Seoul! It was a full day of learning from researchers working across distributed optimisation, decentralised training, and large-scale LLM training. Here’s a brief recap 🧵 1/n