Mirai Labs

@trymirai

Frontier on-device AI lab. Models, runtime & infrastructure to make on-device AI interactive, ambient & continuous.

San Francisco

Pinned
Mirai Labs
@trymirai
Sep 3
Today we are releasing our speculative decoding implementation in our inference engine uzu. Initially for Qwen3.6 27B, with support for Qwen3.8 27B and Muse Glimmer coming soon. On Apple M5-series chips, we outperform MTPLX (MLX + speculative decoding) by almost 2x, and
29
Mirai Labs
@trymirai
Oct 16
Today we’re happy to show uzu.run, early preview of WebGPU support coming into uzu soon. Try it: uzu.run
4
Mirai Labs
@trymirai
Oct 14
882 tok/s prefill on M5 Max for Qwen3.8-27B, with uzu. Compared to Splash: prefill: 1.83x faster time to first token: 1.81x faster generation: 1.05x faster Measured on MT-Bench, MATH-500 and HumanEval.
6
Mirai Labs
@trymirai
Sep 22
Our team loves to catch unique bugs
Artur Chakhvadze
@norpadon
Sep 22
Our GPU whisperer @ychnzhn4 wrote a small blogpost about the most annoying bug I have ever seen, which was an absolute nightmare to catch trymirai.com/blog/tackling-…
Mirai Labs
@trymirai
Jul 9
📣 We've just published our latest research on state-of-the-art speculative decoding in interactivity. Introducing a new approach that achieves a 4.37× speedup over autoregressive decoding in small batch setting and outperforms the strongest tuned DFlash baseline by 24.7%.