What it does
Fully open-source, deployable open source LLM network infrastructure using accessible, consumer hardware
How we built it
Laptops and vibes :)
Challenges we ran into
- Farabi not knowing his mouse was off for ~5 minutes
Accomplishments that we're proud of
$0.25 ARR in 3 hours $1.25 ARR in 3.5 hours $3.30 ARR in 4 hours $3.55 ARR in 5 hours
What we learned
- Vibes are good, even without code
- The best app designs sometimes aren't new apps
How to reproduce it
Computers
- Setup computers as needed, and boot them up
- Install Nix on each computer
- Utilize this Nix setup: https://github.com/MFarabi619/freechatgpt
Network
- Plug a router into ethernet
- Create a network through your Router (in our case, we used D-Link and set credentials)
- (Optional) Alias localhost port 8080 to some URL for ease of use
Open WebUI
- Install Open WebUI
- Serve Open Web UI to port 8080
- Configure users
Future Work
- P2P network to distribute load of compute amongst many computers
Built With
- laptops
Log in or sign up for Devpost to join the conversation.