Deep Communicating Agents for Abstractive Summarization
We present deep communicating agents in an encoder-decoder architecture to address the challenges of representing a long document for abstractive summarization. With deep communicating agents, the task of encoding a long text is divided across multiple collaborating agents, each in charge of a subsection of the input text. These encoders are connected to a single decoder, trained end-to-end using reinforcement learning to generate a focused and coherent summary. Empirical results demonstrate that multiple communicating encoders lead to a higher quality summary compared to several strong baselines, including those based on a single encoder or multiple non-communicating encoders.
Code (0)
등록된 구현이 없습니다.
Tasks
Abstractive Text SummarizationDecoderreinforcement-learningReinforcement LearningReinforcement Learning (RL)Similar Papers 제목 키워드 기반
A Tree-of-Thoughts Inspired Hybrid Approach for Legal Case Judgement Summarization using LLMs
In recent times, Large Language Models (LLMs) are increasingly being used for legal case judgement summarization. Most prior works have tried traditional extractive and abstractive summarization of case judgements. Howev…
Abstractive Document Summarization with a Graph-Based Attentional Neural Model
Abstractive summarization is the ultimate goal of document summarization research, but previously it is less investigated due to the immaturity of text generation techniques. Recently impressive progress has been made to…
Abstractive Text SummarizationDocument SummarizationImage CaptioningMachine Translation+4GupShup: An Annotated Corpus for Abstractive Summarization of Open-Domain Code-Switched Conversations
Code-switching is the communication phenomenon where speakers switch between different languages during a conversation. With the widespread adoption of conversational agents and chat platforms, code-switching has become …
Abstractive Text SummarizationConversation SummarizationUnsupervised Abstractive Summarization of Bengali Text Documents
Abstractive summarization systems generally rely on large collections of document-summary pairs. However, the performance of abstractive systems remains a challenge due to the unavailability of parallel data for low-reso…
Abstractive Text SummarizationExtractive SummarizationLanguage ModelingLanguage Modelling+2Exploring Multitask Learning for Low-Resource AbstractiveSummarization
This paper explores the effect of using multitask learning for abstractive summarization in the context of small training corpora. In particular, we incorporate four different tasks (extractive summarization, language mo…
Abstractive Text SummarizationExtractive SummarizationLanguage ModelingLanguage Modelling