paper-with-me

홈 › Papers

EgoSelf: From Memory to Personalized Egocentric Assistant

2026-04-21 · Yanshuo Wang, Yuan Xu, Xuesong Li, Jie Hong, Yizhou Wang, Chang Wen Chen, Wentao Zhu arxiv

Egocentric assistants often rely on first-person view data to capture user behavior and context for personalized services. Since different users exhibit distinct habits, preferences, and routines, such personalization is essential for truly effective assistance. However, effectively integrating long-term user data for personalization remains a key challenge. To address this, we introduce EgoSelf, a system that includes a graph-based interaction memory constructed from past observations and a dedicated learning task for personalization. The memory captures temporal and semantic relationships among interaction events and entities, from which user-specific profiles are derived. The personalized learning task is formulated as a prediction problem where the model predicts possible future interactions from individual user's historical behavior recorded in the graph. Extensive experiments demonstrate the effectiveness of EgoSelf as a personalized egocentric assistant. Code is available at https://abie-e.github.io/EgoSelf/.

📄 PDF Abstract BibTeX arXiv:2604.19564

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

SuperMemory-VQA: An Egocentric Visual Question-Answering Benchmark for Long-Horizon Memory

2026-05-30 · Samiul Alam, Shakhrul Iman Siam, Michael J. Proulx, James Fort 외 arxiv

AI glasses present a compelling platform for AI agents to serve as personalized memory assistants. To be genuinely useful, such systems must move beyond short-term video comprehension and address memory gaps that humans …

Visual Question AnsweringAction Recognition

TeleEgo: Benchmarking Egocentric AI Assistants in the Wild

2025-10-28 · Jiaqi Yan, Ruilong Ren, Jingren Liu, Shuning Xu 외 arxiv

Egocentric AI assistants in real-world settings must process multi-modal inputs (video, audio, text), respond in real time, and retain evolving long-term memory. However, existing benchmarks typically evaluate these abil…

Personalized Large Language Model Assistant with Evolving Conditional Memory

2023-12-22 · Ruifeng Yuan, Shichao Sun, Yongqi Li, Zili Wang 외

With the rapid development of large language models, AI assistants like ChatGPT have become increasingly integrated into people's works and lives but are limited in personalized services. In this paper, we present a plug…

Language ModelingLanguage ModellingLarge Language ModelRetrieval

EgoLife: Towards Egocentric Life Assistant

2025-03-05 · CVPR 2025 1 · Jingkang Yang, Shuai Liu, Hongming Guo, Yuhao Dong 외

We introduce EgoLife, a project to develop an egocentric life assistant that accompanies and enhances personal efficiency through AI-powered wearable glasses. To lay the foundation for this assistant, we conducted a comp…

Question AnsweringVideo Understanding

In the Eye of MLLM: Benchmarking Egocentric Video Intent Understanding with Gaze-Guided Prompting

2025-09-09 · Taiying Peng, Jiacheng Hua, Miao Liu, Feng Lu arxiv

The emergence of advanced multimodal large language models (MLLMs) has significantly enhanced AI assistants' ability to process complex information across modalities. Recently, egocentric videos, by directly capturing us…

Video Question AnsweringGaze Estimation