I turned structured output into a game 🎮
The LLM scores the next tokens. You pick one. The constraints decide if it’s allowed.
Most likely ≠ valid. Even a capital letter can lose you points.
Watch the demo. Play it yourself below 👇
New York, here I come! 🗽
On Nov 16 I'm speaking at JSNation US about multimodal AI agents that see, hear and remember, all running entirely in your browser.
Voice, vision and memory, all running in the browser. No backend, no API keys 🙌
@nicodotdev, Machine Learning Engineer at @huggingface, shows how WebGPU and WebAssembly make real-time AI agents possible on the open web.
Join us at JSNation US 👇
jsnation.us
More Ternary Bonsai 2 models from @PrismML just dropped: 2B, 4B, 9B, 27B 🌱
Hundreds of tok/s on consumer hardware, fully in the browser with custom WebGPU kernels. At ~1.8 bits/weight the 2B is just 430MB. Local agentic AI is getting wild 🤯
Today has been one of the biggest days for open-source AI this year... and it keeps getting better.
@PrismML just released more Ternary Bonsai 2 models on Hugging Face: now in 2B, 4B, 9B, and 27B. The 2B reaches up to 500 tok/s on my M4 Max ENTIRELY in the browser with custom
