Skip to content

chore: clean up benchmarks#1908

Merged
jonathanpwang merged 4 commits into
feat/new-executionfrom
chore/benchmark-guest-workspace
Jul 27, 2025
Merged

chore: clean up benchmarks#1908
jonathanpwang merged 4 commits into
feat/new-executionfrom
chore/benchmark-guest-workspace

Conversation

@jonathanpwang

@jonathanpwang jonathanpwang commented Jul 27, 2025

Copy link
Copy Markdown
Contributor
  • Put all guest programs for benchmarks into a shared workspace so the
    local openvm imports are clearer.
  • Switch all prove binaries to use the SdkVmConfig and parse it from
    openvm.toml
  • Added a QoL function SdkVmConfig::from_toml -> AppConfig<SdkVmConfig>

- Put all guest programs for benchmarks into a shared workspace so the
  local openvm imports are clearer.
- Switch all prove binaries to use the SdkVmConfig and parse it from
  openvm.toml
@jonathanpwang jonathanpwang added run-benchmark triggers benchmark workflows on the pr run-benchmark-e2e labels Jul 27, 2025
@codspeed-hq

codspeed-hq Bot commented Jul 27, 2025

Copy link
Copy Markdown

CodSpeed WallTime Performance Report

Merging #1908 will not alter performance

Comparing chore/benchmark-guest-workspace (f9d33e5) with feat/new-execution (d572c40)

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

Summary

✅ 24 untouched benchmarks

@github-actions

Copy link
Copy Markdown
group app.proof_time_ms app.cycles app.cells_used leaf.proof_time_ms leaf.cycles leaf.cells_used
verify_fibair 1,117 322,700 17,672,408 - - -
fibonacci (-97 [-4.4%]) 2,114 3,000,420 51,503,521 3,031 1,248,061 70,626,028
regex (-558 [-7.4%]) 6,949 (-113672 [-1.4%]) 8,217,194 (-1761810 [-1.1%]) 163,669,874 9,032 3,326,557 234,117,316
ecrecover (-14 [-1.2%]) 1,116 274,568 8,596,011 9,754 2,934,870 246,667,000
pairing (+44 [+1.2%]) 3,677 3,725,930 93,105,105 4,419 2,010,399 138,830,725
fib_e2e 18,546 24,000,420 410,933,023 16,363 7,462,538 435,494,679
kitchen_sink 14,475 309,192 899,580,290 22,580 7,952,486 748,994,154

Commit: f9d33e5

Benchmark Workflow

@jonathanpwang jonathanpwang merged commit 0c44b81 into feat/new-execution Jul 27, 2025
37 of 38 checks passed
@jonathanpwang jonathanpwang deleted the chore/benchmark-guest-workspace branch July 27, 2025 01:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

run-benchmark triggers benchmark workflows on the pr run-benchmark-e2e

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant