"Exo's use of Llama 405B and consumer-grade devices to run inference at scale on the edge shows that the future of AI is open source and decentralized." - @mo_baioumyx.com/ac_crypto/stat…
Thanks for having me. Big thanks to @jamesnoh13 (@a16z) and Keshav Goal (@Dell) for the great conversation about Inference & Local AI.
Some highlights:
1. You've been running disaggregated inference on your phone for years and didn't even know it. Long before it was a thing in
Incredible work is happening by Team Exo and @nvidia over the last few weeks and man these things are moving really fast and can’t wait to see local AI at your hands soon!