AI-SOVEREIGN
Home / AI Research / Out of Sight, Still in Mind: Token Compression for Omni-LLMs
OUAI Research

Out of Sight, Still in Mind: Token Compression for Omni-LLMs

by kaist-ai · Suho Yoo, Youngjoon Jang, Hyebin Cho, Joon Son Chung

The goal of this paper is to reduce the input token cost of Omni-modal large language models (Omni-LLMs) at inference time. Omni-LLMs reason jointly over audio, video and text, but the cost of the three streams is highly unbalanced: visual tokens account for the vast majority of the input, and are highly redundant. In this paper, we propose ReMo, a training-free framework that compresses visual tokens by redistributing their information across modalities: a visual token is kept only if its information appears nowhere else. ReMo achieves this in two ways: (i) it aligns audio and video in a shared space via closed-form calibration, and removes visual tokens already explained by the audio or…

Upvotes4
Comments2
Published16 Nov 2026

More from kaist-ai