Look Less, Think Faster: Joint Token-Compute Adaptation for Multimodal LLMs

Multimodal Large Language Models (MLLMs) have recently demonstrated strong performance across vision-language tasks.

Multimodal Large Language Models (MLLMs) have recently demonstrated strong performance across vision-language tasks. However, their high inference cost, arising from both the large number of input visual tokens and the heavy computation of the large language model (LLM), remains…