paper-with-me

Papers

AstraNav-Memory: Contexts Compression for Long Memory

2025-12-25 · Botao Ren, Junjun Hu, Xinda Xue, Minghua Luo, Jintao Chen, Haochen Bai, Liangliang You, Mu Xu arxiv

Lifelong embodied navigation requires agents to accumulate, retain, and exploit spatial-semantic experience across tasks, enabling efficient exploration in novel environments and rapid goal reaching in familiar ones. While object-centric memory is interpretable, it depends on detection and reconstruction pipelines that limit robustness and scalability. We propose an image-centric memory framework that achieves long-term implicit memory via an efficient visual context compression module end-to-end coupled with a Qwen2.5-VL-based navigation policy. Built atop a ViT backbone with frozen DINOv3 features and lightweight PixelUnshuffle+Conv blocks, our visual tokenizer supports configurable compression rates; for example, under a representative 16$\times$ compression setting, each image is encoded with about 30 tokens, expanding the effective context capacity from tens to hundreds of images. Experimental results on GOAT-Bench and HM3D-OVON show that our method achieves state-of-the-art navigation performance, improving exploration in unfamiliar environments and shortening paths in familiar ones. Ablation studies further reveal that moderate compression provides the best balance between efficiency and accuracy. These findings position compressed image-centric memory as a practical and scalable interface for lifelong embodied agents, enabling them to reason over long visual histories and navigate with human-like efficiency.

📄 PDF Abstract BibTeX arXiv:2512.21627

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

MELODI: Exploring Memory Compression for Long Contexts

2024-10-04 · Yinpeng Chen, DeLesley Hutchins, Aren Jansen, Andrey Zhmoginov 외

We present MELODI, a novel memory architecture designed to efficiently process long documents using short context windows. The key principle behind MELODI is to represent short-term and long-term memory as a hierarchical…

PReM: Learning What to Preserve and When to Refresh for Context Compression

2026-07-15 · Bohan Yu, Lei Shen, Chenxi Zhou, Chen Han 외 arxiv

Efficient long-context inference is not only about reducing memory cost, but also about keeping useful contextual evidence accessible as generation proceeds. However, existing compression-oriented approaches, such as key…

OmniMem: Perturbation-aware Memory Compression for Streaming Audio-Visual LLMs

2026-05-26 · Guangzhi Sun, Yixuan Li, Yudong Yang, Chao Zhang arxiv

Audio-visual large language models (LLMs) hold strong promise for long-form video understanding, yet their long-video inference is fundamentally limited by the linear growth of video tokens and key-value (KV) caches. We …

StreamMem: Query-Agnostic KV Cache Memory for Streaming Video Understanding

2025-08-21 · Yanlai Yang, Zhuokai Zhao, Satya Narayan Shukla, Aashu Singh 외 arxiv

Multimodal large language models (MLLMs) have made significant progress in visual-language reasoning, but their ability to efficiently handle long videos remains limited. Despite recent advances in long-context MLLMs, st…

Video Question Answering

LoMA: Lossless Compressed Memory Attention

2024-01-16 · Yumeng Wang, Zhenyang Xiao

Large Language Models (LLMs) face limitations due to the high demand on GPU memory and computational resources when handling long contexts. While sparsify the Key-Value (KV) cache of transformer model is a typical strate…

GPU