What it does

Fully open-source, deployable open source LLM network infrastructure using accessible, consumer hardware

How we built it

Laptops and vibes :)

Challenges we ran into

  • Farabi not knowing his mouse was off for ~5 minutes

Accomplishments that we're proud of

$0.25 ARR in 3 hours $1.25 ARR in 3.5 hours $3.30 ARR in 4 hours $3.55 ARR in 5 hours

What we learned

  • Vibes are good, even without code
  • The best app designs sometimes aren't new apps

How to reproduce it

Computers

  1. Setup computers as needed, and boot them up
  2. Install Nix on each computer
  3. Utilize this Nix setup: https://github.com/MFarabi619/freechatgpt

Network

  1. Plug a router into ethernet
  2. Create a network through your Router (in our case, we used D-Link and set credentials)
  3. (Optional) Alias localhost port 8080 to some URL for ease of use

Open WebUI

  1. Install Open WebUI
  2. Serve Open Web UI to port 8080
  3. Configure users

Future Work

  • P2P network to distribute load of compute amongst many computers

Built With

  • laptops
Share this project:

Updates