Do vision-language models look at the image regions they describe? In our new paper, we present Self-Saliency, a method for aligning visual attention with reasoning text.
research.nvidia.com/labs/par/proje… w/ @GalChechik @DalalGal
NLP postdoctoral reasercher (Cornell Tech & Technion), interested in multimodal reasoning

