"Exo's use of Llama 405B and consumer-grade devices to run inference at scale on the edge shows that the future of AI is open source and decentralized." - @mo_baioumyx.com/ac_crypto/stat…
Thanks for having me. Big thanks to @jamesnoh13 (@a16z) and Keshav Goal (@Dell) for the great conversation about Inference & Local AI.
Some highlights:
1. You've been running disaggregated inference on your phone for years and didn't even know it. Long before it was a thing in