Papers Autonomous Web Navigation
“Autonomous Web Navigation” 태그가 달린 논문 9편 · 필터 해제
Context manipulation attacks : Web agents are susceptible to corrupted memory
Autonomous web navigation agents, which translate natural language instructions into sequences of browser actions, are increasingly deployed for complex tasks across e-commerce, information retrieval, and content discove…
Autonomous Web NavigationInformation RetrievalREAL: Benchmarking Autonomous Agents on Deterministic Simulations of Real Websites
We introduce REAL, a benchmark and framework for multi-turn agent evaluations on deterministic simulations of real-world websites. REAL comprises high-fidelity, deterministic replicas of 11 widely-used websites across do…
Autonomous Web NavigationBenchmarkingInformation RetrievalRetrievalMagma: A Foundation Model for Multimodal AI Agents
We present Magma, a foundation model that serves multimodal AI agentic tasks in both the digital and physical worlds. Magma is a significant extension of vision-language (VL) models in that it not only retains the VL und…
Autonomous Web NavigationImage to textmodelRobot ManipulationWEPO: Web Element Preference Optimization for LLM-based Web Navigation
The rapid advancement of autonomous web navigation has significantly benefited from grounding pretrained Large Language Models (LLMs) as agents. However, current research has yet to fully leverage the redundancy of HTML …
Autonomous Web NavigationLanguage ModelingLanguage ModellingST-WebAgentBench: A Benchmark for Evaluating Safety and Trustworthiness in Web Agents
Autonomous web agents solve complex browsing tasks, yet existing benchmarks measure only whether an agent finishes a task, ignoring whether it does so safely or in a way enterprises can trust. To integrate these agents i…
Autonomous Web NavigationAgent-E: From Autonomous Web Navigation to Foundational Design Principles in Agentic Systems
AI Agents are changing the way work gets done, both in consumer and enterprise domains. However, the design patterns and architectures to build highly capable agents or multi-agent systems are still developing, and the u…
Autonomous Web NavigationDenoising"What's important here?": Opportunities and Challenges of Using LLMs in Retrieving Information from Web Interfaces
Large language models (LLMs) that have been trained on a corpus that includes large amount of code exhibit a remarkable ability to understand HTML code. As web interfaces are primarily constructed using HTML, we design a…
Autonomous Web NavigationMultimodal Web Navigation with Instruction-Finetuned Foundation Models
The progress of autonomous web navigation has been hindered by the dependence on billions of exploratory interactions via online reinforcement learning, and domain-specific model designs that make it difficult to leverag…
Autonomous Web NavigationInstruction FollowingLanguage ModellingUnderstanding HTML with Large Language Models
Large language models (LLMs) have shown exceptional performance on a variety of natural language tasks. Yet, their capabilities for HTML understanding -- i.e., parsing the raw HTML of a webpage, with applications to auto…
Autonomous Web NavigationDecoderRetrieval