modern NVMe drives are blazing fast, but software needs to be architected from the ground up to take full advantage of them
we recently rolled out a new I/O scheduler that uses Direct I/O to maximize performance of our SSD caches, avoiding page cache cpu and locking overhead
"Their responsiveness and shipping velocity make us feel like we are their only customer." – Tom Moor, Head of Engineering at Linear
turbopuffer.com/customers/line…
30x daily maintenance job speedup from one simple hack: 41h → 82m 🧹
Bottleneck was paging through S3/GCS prefixes (1:1 w/namespaces). Added a read-through cache of every Nth prefix (N=page_size/2) so now we can list with arbitrary concurrency.
Semantic search improves our agent's accuracy across all frontier models, especially in large codebases where grep alone falls short.
Learn more about our results and how we trained an embedding model for retrieving code.
it was driving us mad that a 96 core box could only drive 13 Gbps from S3
turns out eBPF probes from our network monitoring imposed more overhead than anyone expected
5-10x improvement in network throughput → faster puffin'
