Keep Meeting Summaries on Topic: Abstractive Multi-Modal Meeting Summarization
Transcripts of natural, multi-person meetings differ significantly from documents like news articles, which can make Natural Language Generation models for generating summaries unfocused. We develop an abstractive meeting summarizer from both videos and audios of meeting recordings. Specifically, we propose a multi-modal hierarchical attention across three levels: segment, utterance and word. To narrow down the focus into topically-relevant segments, we jointly model topic segmentation and summarization. In addition to traditional text features, we introduce new multi-modal features derived from visual focus of attention, based on the assumption that the utterance is more important if the speaker receives more attention. Experiments show that our model significantly outperforms the state-of-the-art with both BLEU and ROUGE measures.
Code (0)
등록된 구현이 없습니다.
Tasks
ArticlesMeeting SummarizationText GenerationSimilar Papers 제목 키워드 기반
Abstractive Meeting Summarization UsingDependency Graph Fusion
Automatic summarization techniques on meeting conversations developed so far have been primarily extractive, resulting in poor summaries. To improve this, we propose an approach to generate abstractive summaries by fusin…
Meeting SummarizationSentenceSentence FusionGenerating Abstractive Summaries from Meeting Transcripts
Summaries of meetings are very important as they convey the essential content of discussions in a concise form. Generally, it is time consuming to read and understand the whole documents. Therefore, summaries play an imp…
Document SummarizationSentenceText GenerationAction-Item-Driven Summarization of Long Meeting Transcripts
The increased prevalence of online meetings has significantly enhanced the practicality of a model that can automatically generate the summary of a given meeting. This paper introduces a novel and effective approach to a…
MeetingBank: A Benchmark Dataset for Meeting Summarization
As the number of recorded meetings increases, it becomes increasingly important to utilize summarization technology to create useful summaries of these recordings. However, there is a crucial lack of annotated meeting co…
Meeting SummarizationImproving Abstractive Dialogue Summarization with Hierarchical Pretraining and Topic Segment
With the increasing abundance of meeting transcripts, meeting summary has attracted more and more attention from researchers. The unsupervised pre-training method based on transformer structure combined with fine-tuning …
Abstractive Dialogue SummarizationArticlesDecoderText Summarization+1