paper-with-me

홈 › Papers

Me-Agent: A Personalized Mobile Agent with Two-Level User Habit Learning for Enhanced Interaction

2026-01-28 · Shuoxin Wang, Chang Liu, Gowen Loo, Lifan Zheng, Kaiwen Wei, Xinyi Zeng, Jingyuan Zhang, Yu Tian arxiv

Large Language Model (LLM)-based mobile agents have made significant performance advancements. However, these agents often follow explicit user instructions while overlooking personalized needs, leading to significant limitations for real users, particularly without personalized context: (1) inability to interpret ambiguous instructions, (2) lack of learning from user interaction history, and (3) failure to handle personalized instructions. To alleviate the above challenges, we propose Me-Agent, a learnable and memorable personalized mobile agent. Specifically, Me-Agent incorporates a two-level user habit learning approach. At the prompt level, we design a user preference learning strategy enhanced with a Personal Reward Model to improve personalization performance. At the memory level, we design a Hierarchical Preference Memory, which stores users' long-term memory and app-specific memory in different level memory. To validate the personalization capabilities of mobile agents, we introduce User FingerTip, a new benchmark featuring numerous ambiguous instructions for daily life. Extensive experiments on User FingerTip and general benchmarks demonstrate that Me-Agent achieves state-of-the-art performance in personalization while maintaining competitive instruction execution performance.

📄 PDF Abstract BibTeX arXiv:2601.20162

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Quick on the Uptake: Eliciting Implicit Intents from Human Demonstrations for Personalized Mobile-Use Agents

2025-08-12 · Zheng Wu, Heyuan Huang, Yanjia Yang, Yuanyi Song 외 arxiv

As multimodal large language models advance rapidly, the automation of mobile tasks has become increasingly feasible through the use of mobile-use agents that mimic human interactions from graphical user interfaces. To f…

PerPilot: Personalizing VLM-based Mobile Agents via Memory and Exploration

2025-08-25 · Xin Wang, Zhiyao Cui, Hao Li, Ya Zeng 외 arxiv

Vision language model (VLM)-based mobile agents show great potential for assisting users in performing instruction-driven tasks. However, these agents typically struggle with personalized instructions -- those containing…

MobileAgent: enhancing mobile control via human-machine interaction and SOP integration

2024-01-04 · Tinghe Ding

Agents centered around Large Language Models (LLMs) are now capable of automating mobile device operations for users. After fine-tuning to learn a user's mobile operations, these agents can adhere to high-level user inst…

In-Context Learning

A Closed-Loop Multi-Agent System Driven by LLMs for Meal-Level Personalized Nutrition Management

2026-01-08 · Muqing Xu arxiv

Personalized nutrition management aims to tailor dietary guidance to an individual's intake and phenotype, but most existing systems handle food logging, nutrient analysis and recommendation separately. We present a next…

PSPA-Bench: A Personalized Benchmark for Smartphone GUI Agent

2026-03-31 · Hongyi Nie, Xunyuan Liu, Yudong Bai, Yaqing Wang 외 arxiv

Smartphone GUI agents execute tasks by operating directly on app interfaces, offering a path to broad capability without deep system integration. However, real-world smartphone use is highly personalized: users adopt div…