-
Notifications
You must be signed in to change notification settings - Fork 459
Pull requests: modelscope/evalscope
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
fix(dataset): make dataset and choice shuffling reproducible
#1602
opened Aug 18, 2026 by
Yunnglin
Collaborator
Loading…
refactor(judge): unify LLM judge scoring on a single JSON output contract
#1601
opened Aug 18, 2026 by
Yunnglin
Collaborator
Loading…
feat(benchmark): add olmOCR-Bench document transcription benchmark
#1598
opened Aug 18, 2026 by
ClaireXi99
Loading…
feat(io): unify loading image/video/audio for
general_vmcq
#1595
opened Aug 18, 2026 by
Moenupa
Contributor
Loading…
5 of 6 tasks
feat(metrics): Wilson CI + paired McNemar helpers
#1587
opened Aug 15, 2026 by
KeilerHirsch
Loading…
feat(perf): add startup_ramp_seconds for multi-turn benchmark
#1547
opened Aug 5, 2026 by
yonlunwu
Contributor
Loading…
Add variance-stratified benchmark pruning extension
#1391
opened Jun 2, 2026 by
Shashank-mankala1
Loading…
[WIP] feat(perf): add --max-turn-tokens for per-turn max_tokens override in multi-turn mode
#1359
opened May 22, 2026 by
pjgao
Loading…
ProTip!
Mix and match filters to narrow down what you’re looking for.
