TNG, aka "The Nerd Group", is a consulting partnership focused on high end information technology, particularly AI. 936 employees, 99.9% academics, ~53% PhDs.
DeepSeek V4.1 Flash 1017, our local installation on B300s, system prompt disabled. It thinks it is @AnthropicAI's Claude. AFAWK other posters had results where it thinks it is from OpenAI.
Hmm.
We think that @OpenRouter's "Union Alpha" is a brain of brains, an AutoRouter. First of all, the riddle pattern echoes "Say 'friend' and enter", as it contains "union" in its name and it behaves like one: When faced with probing prompts that bypass caching...
- the timeouts
We get 10 tps with Kimi K3 on our @AIatAMD MI325X*8 node, thanks to the 4bit conversion recipe by @shakudo_io. This is the speed that they also reported. But hey, 10 tps... Does anyone have an idea how to speed this up by A LOT? Else we shard the AMD into 2*4 GPUs and put a
We think that the stealth model "Ox Alpha" on @OpenRouter is a GLM-5.3 variant, as the mean absolute differences (MAD) in their traits are very small. But it appears that not just a vision encoder was added: The three bigger trait differences, namely in "clinical register" (=
