paper-with-me

홈 › Papers

EventVLA: Event-Driven Visual Evidence Memory for Long-Horizon Vision-Language-Action Policies

2026-06-18 · Ganlin Yang, Zhangzheng Tu, Yuqiang Yang, Sitong Mao, Junyi Dong, Tianxing Chen, Jiaqi Peng, Jing Xiong, Jiafei Cao, Jifeng Dai, Wengang Zhou, Yao Mu, Tai Wang arxiv

Memory remains a critical bottleneck for long-horizon robotic manipulation, as standard Vision-Language-Action (VLA) policies often fail when task-relevant cues become occluded or unobservable over time. While existing memory-augmented methods utilize historical context, they either suffer from severe information bottlenecks, incur high latency via decoupled dual systems, or rely on unselective buffers that accumulate massive visual redundancies. To address these limitations, we introduce EventVLA, an end-to-end framework founded on the concept of sparse visual evidence memory that comprises two core components: foundational visual anchors to retain initial and short-term contexts, and a dynamic Keyframe Evidence Memory (KEM) module. Specifically, KEM directly predicts future keyframe probabilities from the VLA's latent embeddings to autonomously capture and store sparse, task-critical visual events. This foresight-driven mechanism empowers the policy to dynamically evaluate the future causal utility of current observations, preserving transient visual evidence before it becomes unobservable. Furthermore, we propose RoboTwin-MeM, a diagnostic benchmark specifically designed to evaluate non-Markovian manipulation tasks with interactive visual evidence. Extensive evaluations show that across 17 memory-requiring simulation tasks and 4 real-world bimanual tasks, EventVLA achieves an average success rate improvement of +40% over state-of-the-art memory-augmented VLAs.

📄 PDF Abstract BibTeX arXiv:2606.20092

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

S3Mem: Structured Spatiotemporal Scene-Event Memory for Long-Horizon Interactive Question Answering

2026-04-10 · Encheng Su, Jianyu Wu, Jinouwen Zhang, Qiucheng Yu 외 arxiv

Long-horizon memory question answering often requires sparse evidence from heterogeneous histories, including events, object states, visual observations, temporal relations, and causal steps. Existing memory interfaces e…

Question Answering

EgoMemReason: A Memory-Driven Reasoning Benchmark for Long-Horizon Egocentric Video Understanding

2026-05-11 · Ziyang Wang, Yue Zhang, Shoubin Yu, Ce Zhang 외 arxiv

Next-generation visual assistants, such as smart glasses, embodied agents, and always-on life-logging systems, must reason over an entire day or more of continuous visual experience. In ultra-long videos, relevant inform…

Video-EM: Event-Centric Episodic Memory for Long-Form Video Understanding

2025-08-13 · Yun Wang, Long Zhang, Jingren Liu, Jiaqi Yan 외 arxiv

Video Large Language Models (Video-LLMs) have shown strong video understanding, yet their application to long-form videos remains constrained by limited context windows. A common workaround is to compress long videos int…

Video Question Answering

MemEye: A Visual-Centric Evaluation Framework for Multimodal Agent Memory

2026-05-14 · Minghao Guo, Qingyue Jiao, Zeru Shi, Yihao Quan 외 arxiv

Long-term agent memory is increasingly multimodal, yet existing evaluations rarely test whether agents preserve the visual evidence needed for later reasoning. In prior work, many visually grounded questions can be answe…

Memory Efficient Corner Detection for Event-driven Dynamic Vision Sensors

2024-01-18 · Pao-Sheng Vincent Sun, Arren Glover, Chiara Bartolozzi, Arindam Basu

Event cameras offer low-latency and data compression for visual applications, through event-driven operation, that can be exploited for edge processing in tiny autonomous agents. Robust, accurate and low latency extracti…

Data CompressionEdge-computing