Pinned
Vik and Val Bercovici (@weka) map where AI inference memory is headed.
Every 100x cut in KV cache gets swallowed by ~10,000x more usage, so demand climbs.
- NVLink beats the board: 128 lanes vs 32 PCIe
- WEKA serves NAND-backed storage faster than DRAM over network
-
