Topic-Aware Contrastive Learning for Abstractive Dialogue Summarization
Unlike well-structured text, such as news reports and encyclopedia articles, dialogue content often comes from two or more interlocutors, exchanging information with each other. In such a scenario, the topic of a conversation can vary upon progression and the key information for a certain topic is often scattered across multiple utterances of different speakers, which poses challenges to abstractly summarize dialogues. To capture the various topic information of a conversation and outline salient facts for the captured topics, this work proposes two topic-aware contrastive learning objectives, namely coherence detection and sub-summary generation objectives, which are expected to implicitly model the topic change and handle information scattering challenges for the dialogue summarization task. The proposed contrastive objectives are framed as auxiliary tasks for the primary dialogue summarization task, united via an alternative parameter updating strategy. Extensive experiments on benchmark datasets demonstrate that the proposed simple method significantly outperforms strong baselines and achieves new state-of-the-art performance. The code and trained models are publicly available via \href{https://github.com/Junpliu/ConDigSum}{https://github.com/Junpliu/ConDigSum}.
Code (1)
Tasks
Abstractive Dialogue SummarizationArticlesContrastive LearningSelf-Supervised LearningText GenerationText SummarizationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Topic-Oriented Spoken Dialogue Summarization for Customer Service with Saliency-Aware Topic Modeling
In a customer service system, dialogue summarization can boost service efficiency by automatically creating summaries for long spoken dialogues in which customers and agents try to address issues about specific topics. I…
Improving Abstractive Dialogue Summarization with Speaker-Aware Supervised Contrastive Learning
Pre-trained models have brought remarkable success on the text summarization task. For dialogue summarization, the subdomain of text summarization, utterances are concatenated to flat text before being processed. As a re…
Abstractive Dialogue SummarizationContrastive LearningText SummarizationImproving Abstractive Dialogue Summarization with Speaker-Aware Supervised Contrastive Learning
Pre-trained models have brought remarkable success on the text summarization task. For dialogue summarization, the subdomain of text summarization, utterances are concatenated to flat text before being processed. As a re…
Abstractive Dialogue SummarizationContrastive LearningText SummarizationUnsupervised Abstractive Dialogue Summarization with Word Graphs and POV Conversion
We advance the state-of-the-art in unsupervised abstractive dialogue summarization by utilizing multi-sentence compression graphs. Starting from well-founded assumptions about word graphs, we present simple but reliable …
Abstractive Dialogue SummarizationRerankingSentenceSentence CompressionImproving Abstractive Dialogue Summarization with Graph Structures and Topic Words
Recently, people have been beginning paying more attention to the abstractive dialogue summarization task. Since the information flows are exchanged between at least two interlocutors and key elements about a certain eve…
Abstractive Dialogue SummarizationGraph AttentionSentence