github.com
[Qwen3.8 and DFLASH2] No continuous batching results in performance benchmarks · Issue #2854 ·...
Describe the bug When using oMLX 0.6.2 build 2360 with DFLASH2 support, the batched requests of a benchmark run do not execute. To Reproduce Steps to reproduce the behavior: Go to Model Downloader ...
