EXO Labs

@exolabs

Frontier AI on local hardware. EXO 1.0 is now open-source (Apache 2.0): github.com/exo-explore/exo

Pinned
EXO Labs
@exolabs
Sep 13, 2024
The future of AI is open source and decentralized
AI at Meta
@AIatMeta
Sep 13, 2024
"Exo's use of Llama 405B and consumer-grade devices to run inference at scale on the edge shows that the future of AI is open source and decentralized." - @mo_baioumy x.com/ac_crypto/stat…
35
EXO Labs
@exolabs
Aug 31
Our patch enabling direct USB-C networking between Apple Silicon Macs and DGX Spark has landed in the mainline Linux Kernel. This simplifies heterogeneous Local AI setups like P/D disaggregation over an ordinary USB-C cable. github.com/torvalds/linux…
93
EXO Labs
@exolabs
Aug 29
macOS 27
10
EXO Labs
@exolabs
Aug 25
exo featured on Apple's new M5 Ultra Mac Studio and M6 / M5 Pro Mac Mini pages. Over the past year, we have worked closely with Apple on low-latency RDMA networking over Thunderbolt 5, enabling clusters of Macs to run massive models like Kimi K3 and GLM-5.3 at API speeds. With
63
EXO Labs
@exolabs
Aug 13
Running Nemotron 3.5 Lightning at 60 tok/sec on 2 x M4 Pro MacBooks with Thunderbolt 5 interconnect on a plane. @NVIDIAAI
Daniel
@imnotchalk
Aug 13
Worlds first @exolabs cluster in the air running nemotron 3.5 lightning 6bit at 60t/s in pi no internet, 2x mbp m4 pro connected via tb5
00:00
5