Does This Summary Answer My Question? Modeling Query-Focused Summary Readers with Rational Speech Acts
Query-focused summarization (QFS) is the task of generating a summary in response to a user-written query. Despite its user-oriented nature, there has been limited work in QFS in explicitly considering a user's understanding of a generated summary, potentially causing QFS systems to underperform at inference time. In this paper, we adapt the Rational Speech Act (RSA) framework, a model of human communication, to explicitly model a reader's understanding of a query-focused summary and integrate it within the generation method of existing QFS systems. In particular, we introduce the answer reconstruction objective which approximates a reader's understanding of a summary by their ability to use it to reconstruct the answer to their initial query. Using this objective, we are able to re-rank candidate summaries generated by existing QFS systems and select summaries that better align with their corresponding query and reference summary. More generally, our study suggests that a simple and effective way of improving a language generation system designed for a user-centered task may be to explicitly incorporate its user requirements into the system's generation procedure.
Code (1)
Tasks
Query-focused SummarizationText GenerationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Coarse-to-Fine Query Focused Multi-Document Summarization
We consider the problem of better modeling query-cluster interactions to facilitate query focused multi-document summarization. Due to the lack of training data, existing work relies heavily on retrieval-style methods fo…
Document SummarizationMulti-Document SummarizationQuestion AnsweringRetrievalQuery Focused Multi-Document Summarization with Distant Supervision
We consider the problem of better modeling query-cluster interactions to facilitate query focused multi-document summarization (QFS). Due to the lack of training data, existing work relies heavily on retrieval-style meth…
Document SummarizationMulti-Document SummarizationQuestion AnsweringRetrievalImprove Query Focused Abstractive Summarization by Incorporating Answer Relevance
Query focused summarization (QFS) models aim to generate summaries from source documents that can answer the given query. Most previous work on QFS only considers the query relevance criterion when producing the summary.…
Abstractive Text SummarizationQuery-focused SummarizationQuestion AnsweringPrivacy Policy Question Answering Assistant: A Query-Guided Extractive Summarization Approach
Existing work on making privacy policies accessible has explored new presentation forms such as color-coding based on the risk factors or summarization to assist users with conscious agreement. To facilitate a more perso…
Extractive SummarizationQuestion AnsweringDTCRS: Dynamic Tree Construction for Recursive Summarization
Retrieval-Augmented Generation (RAG) mitigates the hallucination problem of Large Language Models (LLMs) by incorporating external knowledge. Recursive summarization constructs a hierarchical summary tree by clustering t…
Question Answering