Where to Connect? Boosting MLLMs via Dynamic Gated Pathways across ALL ViT and LLM Layers
> Abstract:A central yet under-explored question in Multimodal Large Language Models (MLLMs) is where to connect---how visual information from a hierarchical vision encoder should