paper-with-me

홈 › Papers

SearchEyes: Towards Frontier Multimodal Deep Search Intelligence via Search World Simulation

2026-07-07 · Zhengbo Jiao, Yiming Cheng, Yilei Jiang, Kaituo Feng, Rui Huang, Tianyi Jiang, Juanxi Tian, Jiapeng li, Qunzhong Wang, Tailai Chen, Qianshan Wei, Chuan Xiao, Shanyu Rong, Yangfu Li, Yanhan Zhou, Yunpu Ma, Yifan Zhang, Xiangyu Yue arxiv

Training multimodal search agents to perform multi-hop reasoning remains challenging due to a fundamental structural disconnect: existing pipelines construct training data, search environments, and reward signals independently, causing synthesized structural metadata to be discarded, environments to rely on irreproducible external engines, and RL rewards to remain sparse at the trajectory level. We present \textbf{SearchEyes}, which uses a typed knowledge graph as the backbone of a \emph{simulated search world} that unifies all three components. We propose \textbf{Perception-Knowledge Chains (PKC)} to sample constrained multi-hop paths over the visual-knowledge intersection of Wikidata5M, retaining hop-level entity metadata that simultaneously defines a self-contained search world and step-level reward anchors. We further propose \textbf{Hop-Anchored Policy Optimization (HaPO)}, which reuses these anchors for step-level credit assignment without a separately trained process reward model. Experiments on six multimodal knowledge-intensive benchmarks show that SearchEyes achieves state-of-the-art performance among open-source multimodal search agents, with SearchEyes-27B improving over the strongest open-source baseline by 6.2 points on average.%

📄 PDF Abstract BibTeX arXiv:2607.05943

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Does Spatial Cognition Emerge in Frontier Models?

2024-10-09 · Santhosh Kumar Ramakrishnan, Erik Wijmans, Philipp Kraehenbuehl, Vladlen Koltun

Not yet. We present SPACE, a benchmark that systematically evaluates spatial cognition in frontier models. Our benchmark builds on decades of research in cognitive science. It evaluates large-scale mapping abilities that…

Frontiers in Collective Intelligence: A Workshop Report

2021-12-13 · Tyler Millhouse, Melanie Moses, Melanie Mitchell

In August of 2021, the Santa Fe Institute hosted a workshop on collective intelligence as part of its Foundations of Intelligence project. This project seeks to advance the field of artificial intelligence by promoting i…

OpenSearch-VL: An Open Recipe for Frontier Multimodal Search Agents

2026-05-06 · Shuang Chen, Kaituo Feng, Hangting Chen, Wenxuan Huang 외 arxiv

Deep search has become a crucial capability for frontier multimodal agents, enabling models to solve complex questions through active search, evidence verification, and multi-step reasoning. Despite rapid progress, top-t…

Reinforcement LearningVisual Grounding

A Survey on Bridging EEG Signals and Generative AI: From Image and Text to Beyond

2025-02-17 · Shreya Shukla, Jose Torres, Abhijit Mishra, Jacek Gwizdka 외

Integration of Brain-Computer Interfaces (BCIs) and Generative Artificial Intelligence (GenAI) has opened new frontiers in brain signal decoding, enabling assistive communication, neural representation learning, and mult…

Contrastive LearningEEGImage Generationmultimodal generation+3

Unlocking Multimodal Document Intelligence: From Current Triumphs to Future Frontiers of Visual Document Retrieval

2026-02-23 · Yibo Yan, Jiahao Huo, Guanbo Feng, Mingdong Ou 외 arxiv

With the rapid proliferation of multimodal information, Visual Document Retrieval (VDR) has emerged as a critical frontier in bridging the gap between unstructured visually rich data and precise information acquisition. …

Image Retrieval