paper-with-me

홈 › Papers

Debate over Mixed-knowledge: A Robust Multi-Agent Reasoning Framework for Incomplete Knowledge Graph Question Answering

2025-11-15 · Jilong Liu, Pengyang Shao, Wei Qin, Fei Liu, Yonghui Yang, Richang Hong arxiv

Knowledge Graph Question Answering (KGQA) aims to improve factual accuracy by leveraging structured knowledge. However, real-world Knowledge Graphs (KGs) are often incomplete, leading to the problem of Incomplete KGQA (IKGQA). A common solution is to incorporate external data to fill knowledge gaps, but existing methods lack the capacity to adaptively and contextually fuse multiple sources, failing to fully exploit their complementary strengths. To this end, we propose Debate over Mixed-knowledge (DoM), a novel framework that enables dynamic integration of structured and unstructured knowledge for IKGQA. Built upon the Multi-Agent Debate paradigm, DoM assigns specialized agents to perform inference over knowledge graphs and external texts separately, and coordinates their outputs through iterative interaction. It decomposes the input question into sub-questions, retrieves evidence via dual agents (KG and Retrieval-Augmented Generation, RAG), and employs a judge agent to evaluate and aggregate intermediate answers. This collaboration exploits knowledge complementarity and enhances robustness to KG incompleteness. In addition, existing IKGQA datasets simulate incompleteness by randomly removing triples, failing to capture the irregular and unpredictable nature of real-world knowledge incompleteness. To address this, we introduce a new dataset, Incomplete Knowledge Graph WebQuestions, constructed by leveraging real-world knowledge updates. These updates reflect knowledge beyond the static scope of KGs, yielding a more realistic and challenging benchmark. Through extensive experiments, we show that DoM consistently outperforms state-of-the-art baselines.

📄 PDF Abstract BibTeX arXiv:2511.12208

Code (0)

등록된 구현이 없습니다.

Tasks

Graph Question AnsweringKnowledge Graphs

Similar Papers 제목 키워드 기반

Debate-Driven Multi-Agent LLMs for Phishing Email Detection

2025-03-27 · Ngoc Tuong Vy Nguyen, Felix D Childress, Yunting Yin

Phishing attacks remain a critical cybersecurity threat. Attackers constantly refine their methods, making phishing emails harder to detect. Traditional detection methods, including rule-based systems and supervised mach…

Language ModelingLanguage ModellingLarge Language Model

L-MAD: A Systematic Evaluation of Multi-Agent Debate Structures in Legal Reasoning

2026-07-10 · Tan-Minh Nguyen, Hoang-Trung Nguyen, Huu-Dong Nguyen, Dinh-Truong Do 외 arxiv

While multi-agent debate (MAD) frameworks have shown significant potential in general reasoning, their effectiveness in highly structured, knowledge-heavy legal domains remains under-explored. In this work, we introduce …

Legal Reasoning

On scalable oversight with weak LLMs judging strong LLMs

2024-07-05 · Zachary Kenton, Noah Y. Siegel, János Kramár, Jonah Brown-Cohen 외

Scalable oversight protocols aim to enable humans to accurately supervise superhuman AI. In this paper we study debate, where two AI's compete to convince a judge; consultancy, where a single AI tries to convince a judge…

Multimodal ReasoningQuestion Answering

Debate to Align: Reliable Entity Alignment through Two-Stage Multi-Agent Debate

2026-04-15 · Cunda Wang, Ziying Ma, Po Hu, Weihua Wang 외 arxiv

Entity alignment (EA) aims to identify entities referring to the same real-world object across different knowledge graphs (KGs). Recent approaches based on large language models (LLMs) typically obtain entity embeddings …

Representation LearningKnowledge GraphsEntity AlignmentDecision Making

Stay Focused: Problem Drift in Multi-Agent Debate

2025-02-26 · Jonas Becker, Lars Benedikt Kaesberg, Andreas Stephan, Jan Philip Wahle 외

Multi-agent debate - multiple instances of large language models discussing problems in turn-based interaction - has shown promise for solving knowledge and reasoning tasks. However, these methods show limitations when s…

Instruction Following