My good friends are making the ultimate harness for local models that just works out of the box. They built their own inference engine in rust, profile hardware, and recommend best fit models.
If you want to get the most out of open source models, highly recommend following Tom
Introducing Magnitude: your actually local agent
100% private and offline. No token costs, no API keys. Open source.
Today's agents are local. The model isn't. Every prompt, every file, every secret gets sent straight to Anthropic and OpenAI.
Magnitude is built around local
