paper-with-me

Papers

Survey on Abstractive Text Summarization: Dataset, Models, and Metrics

2024-12-22 · Gospel Ozioma Nnadi, Flavio Bertini

The advancements in deep learning, particularly the introduction of transformers, have been pivotal in enhancing various natural language processing (NLP) tasks. These include text-to-text applications such as machine translation, text classification, and text summarization, as well as data-to-text tasks like response generation and image-to-text tasks such as captioning. Transformer models are distinguished by their attention mechanisms, pretraining on general knowledge, and fine-tuning for downstream tasks. This has led to significant improvements, particularly in abstractive summarization, where sections of a source document are paraphrased to produce summaries that closely resemble human expression. The effectiveness of these models is assessed using diverse metrics, encompassing techniques like semantic overlap and factual correctness. This survey examines the state of the art in text summarization models, with a specific focus on the abstractive summarization approach. It reviews various datasets and evaluation metrics used to measure model performance. Additionally, it includes the results of test cases using abstractive summarization models to underscore the advantages and limitations of contemporary transformer-based models. The source codes and the data are available at https://github.com/gospelnnadi/Text-Summarization-SOTA-Experiment.

📄 PDF Abstract BibTeX arXiv:2412.17165

Code (2)

data-lang/text-summarization-sota-experiment 공식 구현
gospelnnadi/text-summarization-sota-experiment 공식 구현

Tasks

Abstractive Text SummarizationGeneral KnowledgeImage to textMachine TranslationResponse GenerationSurveytext-classificationText ClassificationText Summarization

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Multi-Head Attention 설명 없음
Position-Wise Feed-Forward Layer 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Similar Papers 제목 키워드 기반

Abstractive Meeting Summarization: A Survey

2022-08-08 · Virgile Rennard, Guokan Shang, Julie Hunter, Michalis Vazirgiannis

A system that could reliably identify and sum up the most important points of a conversation would be valuable in a wide variety of real-world contexts, from business meetings to medical consultations to customer service…

Abstractive Dialogue SummarizationAbstractive Text SummarizationDecoderMeeting Summarization+2

Neural Abstractive Text Summarization with Sequence-to-Sequence Models

2018-12-05 · Tian Shi, Yaser Keneshloo, Naren Ramakrishnan, Chandan K. Reddy

In the past few years, neural abstractive text summarization with sequence-to-sequence (seq2seq) models have gained a lot of popularity. Many interesting techniques have been proposed to improve seq2seq models, making th…

Abstractive Text SummarizationLanguage ModelingLanguage ModellingMachine Translation+2

A Survey on Neural Abstractive Summarization Methods and Factual Consistency of Summarization

2022-04-20 · Meng Cao

Automatic summarization is the process of shortening a set of textual data computationally, to create a subset (a summary) that represents the most important pieces of information in the original text. Existing summariza…

Abstractive Text Summarization

The Factual Inconsistency Problem in Abstractive Text Summarization: A Survey

2021-04-30 · Yichong Huang, Xiachong Feng, Xiaocheng Feng, Bing Qin

Recently, various neural encoder-decoder models pioneered by Seq2Seq framework have been proposed to achieve the goal of generating more abstractive summaries by learning to map input text to output text. At a high level…

Abstractive Text SummarizationDecoderSurveyText Summarization

Analysis of Multidomain Abstractive Summarization Using Salience Allocation

2024-02-19 · Tohida Rehman, Raghubir Bose, Soumik Dey, Samiran Chattopadhyay

This paper explores the realm of abstractive text summarization through the lens of the SEASON (Salience Allocation as Guidance for Abstractive SummarizatiON) technique, a model designed to enhance summarization by lever…

Abstractive Text SummarizationArticlesEvent-Driven TradingText Summarization