Inspiration
There are many people/startups who want to run custom LLMs and there is a lot of unused and valuable compute untapped around the world.
What it does
Our platform allows users to request and access computing power for running custom LLMs and other AI models. By connecting those in need of computational resources with providers who have excess capacity, we facilitate an efficient marketplace that democratizes access to AI technology. Users can easily manage their workloads, while providers can monetize their unused computing power, creating a mutually beneficial ecosystem.
How we built it
Using Exo and alchemy, we made a peer to peer inference networking and payments platform.
Challenges we ran into
To create the demo, we had to find two computers that had sufficient GPU power that were also compatible to host Unix-based applications, which caused some conflict.
What's next for EVOlution
Implementing all of the security features for practical purposes.
Log in or sign up for Devpost to join the conversation.