paper-with-me

홈 › Papers

WEPO: Web Element Preference Optimization for LLM-based Web Navigation

2024-12-14 · Jiarun Liu, Jia Hao, Chunhong Zhang, Zheng Hu

The rapid advancement of autonomous web navigation has significantly benefited from grounding pretrained Large Language Models (LLMs) as agents. However, current research has yet to fully leverage the redundancy of HTML elements for contrastive training. This paper introduces a novel approach to LLM-based web navigation tasks, called Web Element Preference Optimization (WEPO). WEPO utilizes unsupervised preference learning by sampling distance-based non-salient web elements as negative samples, optimizing maximum likelihood objective within Direct Preference Optimization (DPO). We evaluate WEPO on the Mind2Web benchmark and empirically demonstrate that WEPO aligns user high-level intent with output actions more effectively. The results show that our method achieved the state-of-the-art, with an improvement of 13.8% over WebAgent and 5.3% over the visual language model CogAgent baseline. Our findings underscore the potential of preference optimization to enhance web navigation and other web page based tasks, suggesting a promising direction for future research.

📄 PDF Abstract BibTeX arXiv:2412.10742

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous Web NavigationLanguage ModelingLanguage Modelling

Similar Papers 제목 키워드 기반

SWEPO: Simultaneous Weighted Preference Optimization for Group Contrastive Alignment

2024-12-05 · Taneesh Gupta, Rahul Madhavan, Xuchao Zhang, Chetan Bansal 외

We introduce Simultaneous Weighted Preference Optimization (SWEPO), a novel extension of Direct Preference Optimization (DPO) designed to accommodate multiple dynamically chosen positive and negative responses for each q…

NavigScene: Bridging Local Perception and Global Navigation for Beyond-Visual-Range Autonomous Driving

2025-07-07 · Qucheng Peng, Chen Bai, Guoxiang Zhang, Bo Xu 외 arxiv

Autonomous driving systems have made significant advances in Q&A, perception, prediction, and planning based on local visual information, yet they struggle to incorporate broader navigational context that human drivers r…

Reinforcement LearningAutonomous Driving

From Imitation to Discrimination: Progressive Curriculum Learning for Robust Web Navigation

2026-04-14 · Chuang Peng, Wei Zhang, Renshuai Tao, Xinhao Zhang 외 arxiv

Text-based web agents offer computational efficiency for autonomous web navigation, yet developing robust agents remains challenging due to the noisy and heterogeneous nature of real-world HTML. Standard Supervised Fine-…

Computational Efficiency

Listwise Preference Optimization with Element-wise Confusions for Aspect Sentiment Quad Prediction

2025-11-28 · Wenna Lai, Haoran Xie, Guandong Xu, Qing Li 외 arxiv

Aspect sentiment quad prediction (ASQP) is inherently challenging to predict a structured quadruple with four core sentiment elements, including aspect term (a), aspect category (c), opinion term (o), and sentiment polar…

Relational Reasoning

CHOP: Counterfactual Human Preference Labels Improve Obstacle Avoidance in Visuomotor Navigation Policies

2026-03-02 · Gershom Seneviratne, Jianyu An, Vaibhav Shende, Sahire Ellahy 외 arxiv

Visuomotor navigation policies have shown strong perception-action coupling for embodied agents, yet they often struggle with safe navigation and dynamic obstacle avoidance in complex real-world environments. We introduc…