Insightful! I have been thinking about "thinking in video" too
Some further thoughts on the idea of "thinking with images":
1) zero-shot tool use is limited -- you can’t just call an object detector to do visual search. That’s why approaches like VisProg/ViperGPT/Visual-sketchpad will not generalize or scale well.
2) visual search needs to
