paper-with-me

Papers

Personal Visual Memory from Explicit and Implicit Evidence

2026-05-27 · Viet Nguyen, Thao Nguyen, Vishal M. Patel, Yuheng Li arxiv

Long-term memory is increasingly important for personalized AI agents, yet existing benchmarks and methods remain largely text-centric. Even when images are included, the user-specific information needed for later questions is typically recoverable from text alone, and most memory systems reduce image turns to generic captions. Yet images often carry personal information that text rarely states -- both explicit evidence, such as recurring user-associated entities, and implicit evidence, such as latent user facts inferred from visual or multimodal cues. We introduce a benchmark for personal visual memory that targets both forms of evidence, and propose VisualMem, a hybrid visual--text architecture that augments a text-memory backend with a structured personal visual memory module. Rather than collapsing images into captions, VisualMem uses conversational context to resolve identity, ownership, and durable user facts. Experiments show that VisualMem substantially outperforms prior memory systems on our benchmark while remaining competitive on standard text-memory benchmarks, indicating that personal visual memory is a distinct and important component of long-term memory for personalized AI agents.

📄 PDF Abstract BibTeX arXiv:2605.28806

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Explicit v.s. Implicit Memory: Exploring Multi-hop Complex Reasoning Over Personalized Information

2025-08-18 · Zeyu Zhang, Yang Zhang, Haoran Tan, Rui Li 외 arxiv

In large language model-based agents, memory serves as a critical capability for achieving personalization by storing and utilizing users' information. Although some previous studies have adopted memory to implement user…

STALE: Can LLM Agents Know When Their Memories Are No Longer Valid?

2026-05-07 · Hanxiang Chao, Yihan Bai, Rui Sheng, Tianle Li 외 arxiv

Large Language Model (LLM) agents are increasingly expected to maintain coherent, long-term personalized memory, yet current benchmarks primarily measure static fact retrieval, overlooking the ability to revise stored be…

SuperMemory-VQA: An Egocentric Visual Question-Answering Benchmark for Long-Horizon Memory

2026-05-30 · Samiul Alam, Shakhrul Iman Siam, Michael J. Proulx, James Fort 외 arxiv

AI glasses present a compelling platform for AI agents to serve as personalized memory assistants. To be genuinely useful, such systems must move beyond short-term video comprehension and address memory gaps that humans …

Visual Question AnsweringAction Recognition

Tiny-Engram: Trigger-Indexed Concept Tables for Generative Vision

2026-05-19 · Runyuan Cai, Yiming Wang, Yu Lin, Xiaodong Zeng arxiv

Current personalization methods for generative vision models typically encode new concepts through continuous adapters or weight updates, yet provide limited control over whether and when a concept should be retrieved. I…

Video GenerationImage Generation

Personal Visual Context Learning in Large Multimodal Models

2026-05-11 · Zihui Xue, Ami Baid, Sangho Kim, Mi Luo 외 arxiv

As wearable devices like smart glasses integrate Large Multimodal Models (LMMs) into the continuous first-person visual streams of individual users, the evolution of these models into true personal assistants hinges on v…