paper-with-me

홈 › Papers

HyperBrowseComp: A Multilingual and Multimodal Stress Test for Web-Browsing Agents

2026-10-02 · Alham Fikri Aji, Faiz Rizki Ramadhan, Zayd M. K. Zuhri, Seung Hun Eddie Han, Ryandito Diandaru, Qinrong Cui, Jan Christian Blaise Cruz, Badrinath Chandana, Peerawat Chomphooyod, Ahmed Attia, Jonibek Mansurov, Emilio Villa-Cueva, Canh Duong Nguyen, Imran Turganov, Minghao Wu, Peerat Limkonchotiwat, Irina Nikishina hf

We introduce HyperBrowseComp, a multilingual and multimodal browsing benchmark comprising 423 manually authored and human-validated questions across 13 languages, written by native or highly proficient speakers. Questions are designed to be extremely challenging. Each question targets a concise, publicly verifiable answer whose discovery requires locating obscure evidence, following multi-step clue chains, or inspecting heterogeneous sources such as videos, scanned documents, images, or maps. Easier questions are filtered out by evaluating them with models without internet access to reduce the likelihood that they can be answered with parametric knowledge alone. We evaluate several models using provider-native search and a shared external retrieval harness under a common agent protocol. To contextualize model performance and effort, we also conduct a human evaluation on a sample of the questions. HyperBrowseComp provides a challenging testbed for persistent information seeking across languages and evidence modalities, with difficulty arising from discovering and connecting evidence on the open web.

📄 PDF Abstract BibTeX arXiv:2610.03574

Code (3)

Aaron617/agent-arXiv-daily ★ 10
InsomaniacElf/sg-tamil-tts-resources- ★ 1
Tavish9/awesome-daily-AI-arxiv ★ 121

Similar Papers 제목 키워드 기반

A Multilingual Natural Stress Emotion Database

2012-05-01 · LREC 2012 5 · Xin Zuo, Tian Li, Pascale Fung

In this paper, we describe an ongoing effort in collecting and annotating a multilingual speech database of natural stress emotion from university students. The goal is to detect natural stress emotions and study the str…

Emotion RecognitionSpeech Synthesis

K-BrowseComp: A Web Browsing Agent Benchmark Grounded in Korean Contexts

2026-06-01 · Nahyun Lee, Dongkeun Yoon, Guijin Son, Geewook Kim 외 arxiv

Frontier model evaluations are shifting from foundational capabilities (e.g., instruction following and reasoning) toward compositional, agentic ones, but Korean agentic benchmarks remain scarce. We introduce K-BrowseCom…

Instruction Following

Browsing Lost Unformed Recollections: A Benchmark for Tip-of-the-Tongue Search and Reasoning

2025-03-24 · Sky CH-Wang, Darshan Deshpande, Smaranda Muresan, Anand Kannappan 외

We introduce Browsing Lost Unformed Recollections, a tip-of-the-tongue known-item search and reasoning benchmark for general AI assistants. BLUR introduces a set of 573 real-world validated questions that demand searchin…

SAGE: Agentic Framework for Interpretable and Clinically Translatable Computational Pathology Biomarker Discovery

2026-02-01 · Sahar Almahfouz Nasser, Juan Francisco Pesantez Borja, Jincheng Liu, Sandeep Manandhar 외 arxiv

Engineered image-based biomarkers offer a clinically interpretable alternative to black-box AI in computational pathology, yet their discovery remains largely intuition-driven, guided by fragmented literature rather than…

MM-BrowseComp: A Comprehensive Benchmark for Multimodal Browsing Agents

2025-08-14 · Shilong Li, Xingyuan Bu, Wenjie Wang, Jiaheng Liu 외 arxiv

AI agents with advanced reasoning and tool-use capabilities have demonstrated impressive performance in web browsing for deep search. However, existing benchmarks such as BrowseComp primarily focus on textual content, ov…

Multimodal Reasoning