Someone built a free, open-source inference engine that lets you run frontier-scale mixture-of-experts models on a normal PC, so you can use big models without a datacenter.
→ Keeps the most-used experts on the GPU, and the rest in RAM or on disk
→ The README lists 8 GB of
