Bridging Vision and Language Spaces with Assignment Prediction (ICLR 2024) Official code will be available soon