Pinned
AutoText's typing suggestions are now 2x faster!
We're at 800ms RTT per suggestion, still slower than I'd like. For reference, Cursor's gold-standard suggestions land around 250ms.
Inference dominates the latency budget, eating 93%+ of the round trip. After benchmarking dozens
