Generation of Multimedia Artifacts: An Extractive Summarization-based Approach
We explore methods for content selection and address the issue of coherence in the context of the generation of multimedia artifacts. We use audio and video to present two case studies: generation of film tributes, and lecture-driven science talks. For content selection, we use centrality-based and diversity-based summarization, along with topic analysis. To establish coherence, we use the emotional content of music, for film tributes, and ensure topic similarity between lectures and documentaries, for science talks. Composition techniques for the production of multimedia artifacts are addressed as a means of organizing content, in order to improve coherence. We discuss our results considering the above aspects.
Code (0)
등록된 구현이 없습니다.
Tasks
DiversityExtractive SummarizationSimilar Papers 제목 키워드 기반
UniMS: A Unified Framework for Multimodal Summarization with Knowledge Distillation
With the rapid increase of multimedia data, a large body of literature has emerged to work on multimodal summarization, the majority of which target at refining salient information from textual and visual modalities to o…
Abstractive Text SummarizationDecoderImage CaptioningKnowledge Distillation+1Leveraging Word Embeddings for Spoken Document Summarization
Owing to the rapidly growing multimedia content available on the Internet, extractive spoken document summarization, with the purpose of automatically selecting a set of representative sentences from a spoken document to…
Document SummarizationSentenceWord EmbeddingsAudio Summarization with Audio Features and Probability Distribution Divergence
The automatic summarization of multimedia sources is an important task that facilitates the understanding of an individual by condensing the source while maintaining relevant information. In this paper we focus on audio …
Extractive SummarizationInformativenessPositionEASE: Extractive-Abstractive Summarization End-to-End using the Information Bottleneck Principle
Current abstractive summarization systems outperform their extractive counterparts, but their widespread adoption is inhibited by the inherent lack of interpretability. Extractive summarization systems, though interpreta…
Abstractive Text SummarizationExtractive SummarizationText Generation