⚡🛡️ Evan Pappas
@Hevalon
🛡️ Ex Technologia Libertas - Έλευθερία διὰ τῆς τέχνης - (Dec/Acc)
- An agent loop that passes every test it has can run seven times slower the moment it shares a cluster, with nothing inside it changed. open.substack.com/pub/hyperautom…
- A KV cache hit skips prefill, so it comes back faster than a miss. Roughly 0.6s vs 4.3s on a repeated 10K-token prompt. Time the response and you learn "has my neighbor prompted this exact text?" No access to their data required.
- I stood up Llama-3.1-70B on two H100s. Four concurrent users in, the queue backed up while nvidia-smi showed the cards barely working. I added two more H100s. Nothing changed. hyperautomation.substack.com/p/the-gpu-that…
- hey anon, don't you wonder how much your pet project cost you in tokens? FinOps for AI 🚀
