It was a pleasure to have presented our research on model quantization, using Apex as the subject, during @AgentConf, with @LeSiOO.
If you are using the Gemma 4 family, you can use our results directly. For other cases, we show the method to find the sweet spot for any model.
How does quantization affect APEX performance? 🔬
Artur Morys-Magiera @artus9033 and I shared our research at @AgentConf . We hope our findings help the community make more informed decisions about quantization.
🎥 youtu.be/XLoY8PpYXNU
