Deep Learning Models for Automatic Summarization

2020-05-25 · Pirmin Lemberger

Text summarization is an NLP task which aims to convert a textual document into a shorter one while keeping as much meaning as possible. This pedagogical article reviews a number of recent Deep Learning architectures that have helped to advance research in this field. We will discuss in particular applications of pointer networks, hierarchical Transformers and Reinforcement Learning. We assume basic knowledge of Seq2Seq architecture and Transformer networks within NLP.

📄 PDF Abstract BibTeX arXiv:2005.11988

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Text Summarization

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Position-Wise Feed-Forward Layer 설명 없음

Sigmoid Activation 설명 없음

Tanh Activation 설명 없음

LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…

Residual Connection 설명 없음

Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Revisiting Automatic Question Summarization Evaluation in the Biomedical Domain

2023-03-18 · Hongyi Yuan, Yaoyun Zhang, Fei Huang, Songfang Huang

Automatic evaluation metrics have been facilitating the rapid development of automatic summarization methods by providing instant and fair assessments of the quality of summaries. Most metrics have been developed for the…

Text Generation

DACSA: A large-scale Dataset for Automatic summarization of Catalan and Spanish newspaper Articles

2022-07-01 · NAACL 2022 7 · Encarnación Segarra Soriano, Vicent Ahuir, Lluís-F. Hurtado, José González

The application of supervised methods to automatic summarization requires the availability of adequate corpora consisting of a set of document-summary pairs. As in most Natural Language Processing tasks, the great majori…

Abstractive Text Summarization Articles Benchmarking

Evaluation of Automatic Text Summarization using Synthetic Facts

2022-04-11 · Jay Ahn, Foaad Khosmood

Despite some recent advances, automatic text summarization remains unreliable, elusive, and of limited practical use in applications. Two main problems with current summarization methods are well known: evaluation and fa…

Text Summarization

NLP Driven Ensemble Based Automatic Subtitle Generation and Semantic Video Summarization Technique

2019-04-22 · VB Aswin, Mohammed Javed, Parag Parihar, K Aswanth 외

This paper proposes an automatic subtitle generation and semantic video summarization technique. The importance of automatic video summarization is vast in the present era of big data. Video summarization helps in effici…

speech-recognition Speech Recognition Text Summarization Video Summarization

Align then Summarize: Automatic Alignment Methods for Summarization Corpus Creation

2020-07-15 · LREC 2020 5 · Paul Tardy, David Janiszek, Yannick Estève, Vincent Nguyen

Summarizing texts is not a straightforward task. Before even considering text summarization, one should determine what kind of summary is expected. How much should the information be compressed? Is it relevant to reformu…

Articles Meeting Summarization Text Summarization