paper-with-me

홈 › Papers

MemOCR: Layout-Aware Visual Memory for Efficient Long-Horizon Reasoning

2026-01-29 · Yaorui Shi, Shugui Liu, Yu Yang, Wenyu Mao, Yuxin Chen, Qi GU, Hui Su, Xunliang Cai, Xiang Wang, An Zhang arxiv

Long-horizon agentic reasoning necessitates effectively compressing growing interaction histories into a limited context window. Most existing memory systems serialize history as text, where token-level cost is uniform and scales linearly with length, often spending scarce budget on low-value details. To this end, we introduce MemOCR, a multimodal memory agent that improves long-horizon reasoning under tight context budgets by allocating memory space with adaptive information density through visual layout. Concretely, MemOCR maintains a structured rich-text memory (e.g., headings, highlights) and renders it into an image that the agent consults for memory access, visually prioritizing crucial evidence while aggressively compressing auxiliary details. To ensure robustness across varying memory budgets, we train MemOCR with reinforcement learning under budget-aware objectives that expose the agent to diverse compression levels. Across long-context multi-hop and single-hop question-answering benchmarks, MemOCR outperforms strong text-based baselines and achieves more effective context utilization under extreme budgets.

📄 PDF Abstract BibTeX arXiv:2601.21468

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement Learning

Similar Papers 제목 키워드 기반

MemoCRS: Memory-enhanced Sequential Conversational Recommender Systems with Large Language Models

2024-07-06 · Yunjia Xi, Weiwen Liu, Jianghao Lin, Bo Chen 외

Conversational recommender systems (CRSs) aim to capture user preferences and provide personalized recommendations through multi-round natural language dialogues. However, most existing CRS models mainly focus on dialogu…

Recommendation Systems

LongSpace: Exploring Long-Horizon Spatial Memory from Perception to Recall in Video

2026-06-04 · Shiqiang Lang, Jing Liu, Haoyang He, Peiwen Sun 외 arxiv

Multimodal Large Language Models (MLLMs) have advanced image and video understanding and can increasingly handle longer visual inputs. Long-horizon tasks such as autonomous driving and robotic navigation require more tha…

Autonomous DrivingSpatial Reasoning

LoRaLay: A Multilingual and Multimodal Dataset for Long Range and Layout-Aware Summarization

2023-01-26 · Laura Nguyen, Thomas Scialom, Benjamin Piwowarski, Jacopo Staiano

Text Summarization is a popular task and an active area of research for the Natural Language Processing community. By definition, it requires to account for long input texts, a characteristic which poses computational ch…

Text Summarization

Retrieval-Augmented Layout Transformer for Content-Aware Layout Generation

2023-11-22 · CVPR 2024 1 · Daichi Horita, Naoto Inoue, Kotaro Kikuchi, Kota Yamaguchi 외

Content-aware graphic layout generation aims to automatically arrange visual elements along with a given content, such as an e-commerce product image. In this paper, we argue that the current layout generation approaches…

Layout GenerationRetrieval

MangaFlow: An End-to-End Agentic Framework for Controllable Story to Manga Generation

2026-05-27 · Muyao Wang, Zeke Xie, Yanhao Chen, Lixin Xiu 외 arxiv

End-to-end manga generation is a structured visual storytelling task that requires story decomposition, recurring character and scene grounding, page layout design, panel rendering, page composition, and lettering. Howev…

Visual Storytelling