paper-with-me

홈 › Papers

Conan: Progressive Learning to Reason Like a Detective over Multi-Scale Visual Evidence

2025-10-23 · Kun Ouyang, Yuanxin Liu, Linli Yao, Yishuo Cai, Hao Zhou, Jie Zhou, Fandong Meng, Xu Sun arxiv

Video reasoning, which requires multi-step deduction across frames, remains a major challenge for multimodal large language models (MLLMs). While reinforcement learning (RL)-based methods enhance reasoning capabilities, they often rely on text-only chains that yield ungrounded or hallucinated conclusions. Conversely, frame-retrieval approaches introduce visual grounding, yet still struggle with inaccurate evidence localization. To address these limitations, we present Conan, a framework for evidence-grounded multi-step video reasoning. Conan identifies context and evidence frames, reasons over cross-frame clues, and adaptively decides when to conclude or explore further. To achieve this, we 1) construct Conan-91K, a large-scale dataset of automatically generated reasoning traces that include frame identification, evidence reasoning, and action decision, and 2) design a multi-stage progressive cold-start strategy combined with an Identification-Reasoning-Action (AIR) RLVR training framework to progressively incentivize multi-step visual reasoning. Extensive experiments on six multi-step reasoning benchmarks demonstrate that Conan surpasses the baseline Qwen2.5-VL-7B-Instruct by an average of over 10% in accuracy, achieving state-of-the-art performance. Furthermore, Conan generalizes effectively to long video understanding tasks, validating its strong scalability and robustness.

📄 PDF Abstract BibTeX arXiv:2510.20470

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement LearningVisual ReasoningVisual Grounding

Similar Papers 제목 키워드 기반

Large Language Models Fall Short: Understanding Complex Relationships in Detective Narratives

2024-02-16 · Runcong Zhao, Qinglin Zhu, Hainiu Xu, Jiazheng Li 외

Existing datasets for narrative understanding often fail to represent the complexity and uncertainty of relationships in real-life social scenarios. To address this gap, we introduce a new benchmark, Conan, designed for …

RimiRec: Modeling Refined Multi-interest in Hierarchical Structure for Recommendation

2024-02-02 · Haolei Pei, Yuanyuan Xu, Yangping Zhu, Yuan Nie

Industrial recommender systems usually consist of the retrieval stage and the ranking stage, to handle the billion-scale of users and items. The retrieval stage retrieves candidate items relevant to user interests for re…

Recommendation SystemsRetrieval

Active Reasoning in an Open-World Environment

2023-11-03 · NeurIPS 2023 11

Recent advances in vision-language learning have achieved notable success on complete-information question-answering datasets through the integration of extensive world knowledge. Yet, most models operate passively, resp…

Instruction FollowingMinecraftQuestion AnsweringWorld Knowledge

FC-CONAN: An Exhaustively Paired Dataset for Robust Evaluation of Retrieval Systems

2026-01-04 · Juan Junqueras, Florian Boudin, May-Myo Zin, Ha-Thanh Nguyen 외 arxiv

Hate speech (HS) is a critical issue in online discourse, and one promising strategy to counter it is through the use of counter-narratives (CNs). Datasets linking HS with CNs are essential for advancing counterspeech re…

Piecing Together Clues: A Benchmark for Evaluating the Detective Skills of Large Language Models

2023-07-11 · Zhouhong Gu, Lin Zhang, Jiangjie Chen, Haoning Ye 외

Detectives frequently engage in information detection and reasoning simultaneously when making decisions across various cases, especially when confronted with a vast amount of information. With the rapid development of l…

Common Sense ReasoningDecision MakingPrompt EngineeringReading Comprehension