I have a strong feeling that I should take a look at sglang / vllm
Last time I have that kind of feeling is for Kubernetes at 2017
🤔
STRRL.dev
@strrl_the_dev
Site Reboot Engineer
- things are gonna be weirdintroducing Halo X, always listening AI glasses. vibe think. never use your brain again. pre-order now.
- Saturday isn’t a break, it’s a build.
- A Mac is always worth its price. 🤤 It's not only about the hardware specs, but also the software ecosystem, and the delightful user experienceI tried building ChatWise (Tauri) on this CPU, the Rust part took 15 seconds, while on Mac Mini M4 it’s 4 seconds.
