Help us understand how different robot policies perform by comparing side-by-side video clips.
Thank you for participating in our study! Your feedback will help us understand how different robot policies perform on simulated manipulation tasks.
In this study, you will watch short video clips showing two robots (side-by-side) attempting to complete the same task (e.g., stacking, moving objects). Each robot follows a different control policy.
For each pair of videos, first briefly describe what each robot did. Watch both videos fully before judging, rather than deciding from halfway behavior. Then give each video its own score from 0 to 100, where 100 means the robot fully succeeded at the task. After that, choose which robot performed better overall, or mark a tie if the two videos look equally good or equally bad.
Select your participant type and enter a unique ID to begin. Using the same ID on the same browser lets you resume your progress.
Here's an example trial. Watch both videos fully, describe each robot's attempt, assign each video a 0-100 score where 100 means full task success, then choose which policy performed better overall.
If a video is slow to load, please wait a moment or refresh the page.
Describe both videos above to continue.
After completing all clips you will receive a completion code to submit for credit.
