paper-with-me

Papers

LLM-Explorer: Towards Efficient and Affordable LLM-based Exploration for Mobile Apps

2025-05-15 · Shanhui Zhao, Hao Wen, Wenjie Du, Cheng Liang, Yunxin Liu, Xiaozhou Ye, Ye Ouyang, Yuanchun Li

Large language models (LLMs) have opened new opportunities for automated mobile app exploration, an important and challenging problem that used to suffer from the difficulty of generating meaningful UI interactions. However, existing LLM-based exploration approaches rely heavily on LLMs to generate actions in almost every step, leading to a huge cost of token fees and computational resources. We argue that such extensive usage of LLMs is neither necessary nor effective, since many actions during exploration do not require, or may even be biased by the abilities of LLMs. Further, based on the insight that a precise and compact knowledge plays the central role for effective exploration, we introduce LLM-Explorer, a new exploration agent designed for efficiency and affordability. LLM-Explorer uses LLMs primarily for maintaining the knowledge instead of generating actions, and knowledge is used to guide action generation in a LLM-less manner. Based on a comparison with 5 strong baselines on 20 typical apps, LLM-Explorer was able to achieve the fastest and highest coverage among all automated app explorers, with over 148x lower cost than the state-of-the-art LLM-based approach.

📄 PDF Abstract BibTeX arXiv:2505.10593

Code (1)

mobilellm/llm-explorer 공식 구현

Tasks

Action Generation

Similar Papers 제목 키워드 기반

MobileExplorer: Accelerating On-Device Inference for Mobile GUI Agents via Online Exploration

2026-05-26 · Runxi Huang, Liyu Zhang, Shengzhong Liu, Xiaomin Ouyang arxiv

Mobile graphical user interface (GUI) agents enable AI models to autonomously operate smartphones on behalf of users. However, most existing systems focus primarily on optimizing task accuracy and rely on cloud-hosted mo…

GUI-explorer: Autonomous Exploration and Mining of Transition-aware Knowledge for GUI Agent

2025-05-22 · Bin Xie, Rui Shao, Gongwei Chen, Kaiwen Zhou 외

GUI automation faces critical challenges in dynamic environments. MLLMs suffer from two key issues: misinterpreting UI components and outdated knowledge. Traditional fine-tuning methods are costly for app-specific knowle…

From Exploration to Revelation: Detecting Dark Patterns in Mobile Apps

2024-11-27 · Jieshan Chen, Zhen Wang, Jiamou Sun, Wenbo Zou 외

Mobile apps are essential in daily life, yet they often employ dark patterns, such as visual tricks to highlight certain options or linguistic tactics to nag users into making purchases, to manipulate user behavior. Curr…

Contrastive Learning

OVD-Explorer: Optimism Should Not Be the Sole Pursuit of Exploration in Noisy Environments

2023-12-19 · Jinyi Liu, Zhi Wang, Yan Zheng, Jianye Hao 외

In reinforcement learning, the optimism in the face of uncertainty (OFU) is a mainstream principle for directing exploration towards less explored areas, characterized by higher uncertainty. However, in the presence of e…

continuous-controlContinuous ControlMuJoCo

Explorer: Scaling Exploration-driven Web Trajectory Synthesis for Multimodal Web Agents

2025-02-17 · Vardaan Pahuja, Yadong Lu, Corby Rosset, Boyu Gou 외

Recent success in large multimodal models (LMMs) has sparked promising applications of agents capable of autonomously completing complex web tasks. While open-source LMM agents have made significant advances in offline e…