Not All Modalities Are Equal: Instruction-Aware Gating for Multimodal Videos 事件

Not All Modalities Are Equal: Instruction-Aware Gating for Multimodal Videos arXiv:2605.26232v1 Announce Type: new Abstract: Pre-trained video large language models excel at visual reasoning. However, they struggle when videos arrive with auxiliary streams, such as audio, depth map, or dense temporal evidence. In such a scenario, uniform fusion induces modality interference, allowing irrelevant channels to distract the model. To address this issue, we present a unified multimodal video understa