paper-with-me

Papers

Beyond Relevant Documents: A Knowledge-Intensive Approach for Query-Focused Summarization using Large Language Models

2024-08-19 · Weijia Zhang, Jia-Hong Huang, Svitlana Vakulenko, Yumo Xu, Thilina Rajapakse, Evangelos Kanoulas

Query-focused summarization (QFS) is a fundamental task in natural language processing with broad applications, including search engines and report generation. However, traditional approaches assume the availability of relevant documents, which may not always hold in practical scenarios, especially in highly specialized topics. To address this limitation, we propose a novel knowledge-intensive approach that reframes QFS as a knowledge-intensive task setup. This approach comprises two main components: a retrieval module and a summarization controller. The retrieval module efficiently retrieves potentially relevant documents from a large-scale knowledge corpus based on the given textual query, eliminating the dependence on pre-existing document sets. The summarization controller seamlessly integrates a powerful large language model (LLM)-based summarizer with a carefully tailored prompt, ensuring the generated summary is comprehensive and relevant to the query. To assess the effectiveness of our approach, we create a new dataset, along with human-annotated relevance labels, to facilitate comprehensive evaluation covering both retrieval and summarization performance. Extensive experiments demonstrate the superior performance of our approach, particularly its ability to generate accurate summaries without relying on the availability of relevant documents initially. This underscores our method's versatility and practical applicability across diverse query scenarios.

📄 PDF Abstract BibTeX arXiv:2408.10357

Code (0)

등록된 구현이 없습니다.

Tasks

Language ModelingLanguage ModellingLarge Language ModelQuery-focused SummarizationRetrieval

Similar Papers 제목 키워드 기반

Tackling Query-Focused Summarization as A Knowledge-Intensive Task: A Pilot Study

2021-12-14 · Weijia Zhang, Svitlana Vakulenko, Thilina Rajapakse, Yumo Xu 외

Query-focused summarization (QFS) requires generating a summary given a query using a set of relevant documents. However, such relevant documents should be annotated manually and thus are not readily available in realist…

Open-Domain Question AnsweringPassage RetrievalQuery-focused SummarizationQuestion Answering+2

DR-RAG: Applying Dynamic Document Relevance to Retrieval-Augmented Generation for Question-Answering

2024-06-11 · Zijian Hei, Weiling Liu, Wenjie Ou, Juyi Qiao 외

Retrieval-Augmented Generation (RAG) has recently demonstrated the performance of Large Language Models (LLMs) in the knowledge-intensive tasks such as Question-Answering (QA). RAG expands the query context by incorporat…

Question AnsweringRAGRetrievalRetrieval-augmented Generation

Compute Allocation for Reasoning-Intensive Retrieval Agents

2026-03-15 · Sreeja Apparaju, Nilesh Gupta arxiv

As agents operate over long horizons, their memory stores grow continuously, making retrieval critical to accessing relevant information. Many agent queries require reasoning-intensive retrieval, where the connection bet…

On the Vulnerability of Applying Retrieval-Augmented Generation within Knowledge-Intensive Application Domains

2024-09-12 · Xun Xian, Ganghua Wang, Xuan Bi, Jayanth Srinivasa 외

Retrieval-Augmented Generation (RAG) has been empirically shown to enhance the performance of large language models (LLMs) in knowledge-intensive domains such as healthcare, finance, and legal contexts. Given a query, RA…

Adversarial RobustnessRAGRetrievalRetrieval-augmented Generation

BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrieval

2024-07-16 · Hongjin Su, Howard Yen, Mengzhou Xia, Weijia Shi 외

Existing retrieval benchmarks primarily consist of information-seeking queries (e.g., aggregated questions from search engines) where keyword or semantic-based retrieval is usually sufficient. However, many complex real-…

Question AnsweringRetrievalText Retrieval