paper-with-me

Papers

EffiQA: Efficient Question-Answering with Strategic Multi-Model Collaboration on Knowledge Graphs

2024-06-03 · Zixuan Dong, Baoyun Peng, YuFei Wang, Jia Fu, Xiaodong Wang, Yongxue Shan, Xin Zhou

While large language models (LLMs) have shown remarkable capabilities in natural language processing, they struggle with complex, multi-step reasoning tasks involving knowledge graphs (KGs). Existing approaches that integrate LLMs and KGs either underutilize the reasoning abilities of LLMs or suffer from prohibitive computational costs due to tight coupling. To address these limitations, we propose a novel collaborative framework named EffiQA that can strike a balance between performance and efficiency via an iterative paradigm. EffiQA consists of three stages: global planning, efficient KG exploration, and self-reflection. Specifically, EffiQA leverages the commonsense capability of LLMs to explore potential reasoning pathways through global planning. Then, it offloads semantic pruning to a small plug-in model for efficient KG exploration. Finally, the exploration results are fed to LLMs for self-reflection to further improve the global planning and efficient KG exploration. Empirical evidence on multiple KBQA benchmarks shows EffiQA's effectiveness, achieving an optimal balance between reasoning accuracy and computational costs. We hope the proposed new framework will pave the way for efficient, knowledge-intensive querying by redefining the integration of LLMs and KGs, fostering future research on knowledge-based question answering.

📄 PDF Abstract BibTeX arXiv:2406.01238

Code (0)

등록된 구현이 없습니다.

Tasks

Knowledge GraphsQuestion Answering

Methods 이 논문이 사용한 방법론

Pruning 설명 없음

Similar Papers 제목 키워드 기반

CURE: Confidence-driven Unified Reasoning Ensemble Framework for Medical Question Answering

2025-10-16 · Ziad Elshaer, Essam A. Rashed arxiv

High-performing medical Large Language Models (LLMs) typically require extensive fine-tuning with substantial computational resources, limiting accessibility for resource-constrained healthcare institutions. This study i…

Question Answering

EvolveRouter: Co-Evolving Routing and Prompt for Multi-Agent Question Answering

2026-04-06 · Jiatan Huang, Zheyuan Zhang, Kaiwen Shi, Yanfang Ye 외 arxiv

Large language model agents often exhibit complementary strengths, making routing a promising approach for multi-agent question answering. However, existing routing methods remain limited in two important ways: they typi…

Question Answering

Efficient Multi-Agent Collaboration with Tool Use for Online Planning in Complex Table Question Answering

2024-12-28 · Wei Zhou, Mohsen Mesgar, Annemarie Friedrich, Heike Adel

Complex table question answering (TQA) aims to answer questions that require complex reasoning, such as multi-step or multi-category reasoning, over data represented in tabular form. Previous approaches demonstrated nota…

Question Answering

The Open Framework for Developing Knowledge Base And Question Answering System

2016-12-01 · COLING 2016 12 · Jiseong Kim, Gyu-Hyeon Choi, Jung-Uk Kim, Eun-Kyung Kim 외

Developing a question answering (QA) system is a task of implementing and integrating modules of different technologies and evaluating an integrated whole system, which inevitably goes with a collaboration among experts …

Question AnsweringReading Comprehension

MAMM-Refine: A Recipe for Improving Faithfulness in Generation with Multi-Agent Collaboration

2025-03-19 · David Wan, Justin Chih-Yao Chen, Elias Stengel-Eskin, Mohit Bansal

Multi-agent collaboration among models has shown promise in reasoning tasks but is underexplored in long-form generation tasks like summarization and question-answering. We extend multi-agent multi-model reasoning to gen…

Long Form Question AnsweringQuestion AnsweringReranking