A Very Big Video Reasoning Suite

We bet on a future that video reasoning is the next fundamental intelligence paradigm, after language reasoning, where spatiotemporal embodied world experiences could be more naturally captured.

Paper
Data
Model
EvalKit
Leaderboard

Data Engines

View All
ball_bounces_given_time
GitHub
Knowledge in-domain testset
Prompt
A ball is placed at the initial position with a direction arrow indicating its movement direction. Simulate the ball bouncing 2 times off the boundary walls following elastic collision physics (angle of incidence equals angle of reflection). The ball stops after the 2th bounce, with its final position at the wall where the last collision occurs.
First Frame
First Frame
Last Frame
Last Frame
Video
shape_outline_then_move
GitHub
Abstraction in-domain testset
Prompt
The scene shows an analogy A→B→C :: D→?→? with two rows of shapes and arrows. On the top row, a filled oval first becomes an outline-only oval (step 1), then moves up by a small amount (step 2). On the bottom row, the star starts filled. Apply the same two-step transformation: first convert it to outline-only style, then move it up by a small amount, keeping its shape and size the same while only the style and position change.
First Frame
First Frame
Last Frame
Last Frame
Video
key_door_matching
GitHub
Spatiality in-domain testset
Prompt
The scene shows a maze with a green circular agent, colored diamond-shaped keys, and colored hollow rectangular doors. Find the Blue key and then navigate to the matching Blue door, showing the complete movement process step by step.
First Frame
First Frame
Last Frame
Last Frame
Video
animal_matching
GitHub
Transformation out-of-domain testset
Prompt
Colored animal faces are on the left side of the canvas, and dark outlines of animals are on the right side. Move each colored animal face to its matching outline via the shortest path.
First Frame
First Frame
Last Frame
Last Frame
Video
identify_pentagons
GitHub
Perception out-of-domain testset
Prompt
Multiple polygons are shown; exactly one of them is a pentagon (5 sides). Identify that pentagon and mark it with a red circle that expands from the inside out to encircle the shape. Do not change anything else.
First Frame
First Frame
Last Frame
Last Frame
Video

Inference Results

View Full Bench
Gravity Physics - Samples
00
01
02
03
04
Task Domains 1/5
Gravity Physics
Knowledge out-of-domain testset
Next Figure (Increasing Size)
Abstraction in-domain testset
Outline Innermost Square
Spatiality out-of-domain testset
Symbol Edit
Transformation out-of-domain testset
Majority Color
Perception in-domain testset
Prompt
Loading...
Ground Truth
First
First Frame
Final
Final Frame
Model Outputs
1/
VBVR-Wan2.2
VBVR-Wan2.2
CogVideoX 1.5
Kling 2.6
LTX-2
Runway Gen-4
Sora 2
Veo 3
Wan 2.2 I2V
Hunyuan I2V
Seedance 2.0

Leaderboard

Modality
Split
Type
Category
2026-04-28