ComputeSDK

@computesdk

Independent benchmarks for compute

ComputeSDK
@computesdk
Aug 28
It's Benchmark Friday and the results are in for sandboxes, ai gateway, storage, and browsers. Of course, none of this would be possible without our amazing partners. See the thread for more info.
ComputeSDK
@computesdk
Aug 21
It's Benchmark Friday and we've added in 3 new baselines for the ai gateway benchmarks. Every Friday we run 4 categories of benchmarks - sandbox - ai gateway - storage - browsers ofc none of this would be possible without our partners. See the 🧵 for more info.
ComputeSDK
@computesdk
Aug 14
It's Benchmark Friday and this weeks results are in. Every Friday we run 4 categories of benchmarks - sandbox - ai gateway - storage - browsers ofc none of this would be possible without our partners. See the 🧵 for more info.
ComputeSDK
@computesdk
Aug 7
We're back with another addition of Benchmark Friday. It's been about 3 or 4 weeks since we switched to weekly runs and things seem to be progressing nicely. In the next few weeks we'll be rolling out daily test runs to the providers to help them build.
00:00
ComputeSDK
@computesdk
Jul 31
We just did a re-run of our AI Gateway benchmarks for ALL participants. We found some issues in our AI Gateway benchmark specifically with our implementation in tracking tokens per second on @concentrateai. 10% of the composite score is weighted for tokens per second so this