paper-with-me

홈 › Papers

Semi-Supervised Dialogue Abstractive Summarization via High-Quality Pseudolabel Selection

2024-03-06 · Jianfeng He, Hang Su, Jason Cai, Igor Shalyminov, Hwanjun Song, Saab Mansour

Semi-supervised dialogue summarization (SSDS) leverages model-generated summaries to reduce reliance on human-labeled data and improve the performance of summarization models. While addressing label noise, previous works on semi-supervised learning primarily focus on natural language understanding tasks, assuming each sample has a unique label. However, these methods are not directly applicable to SSDS, as it is a generative task, and each dialogue can be summarized in different ways. In this work, we propose a novel scoring approach, SiCF, which encapsulates three primary dimensions of summarization model quality: Semantic invariance (indicative of model confidence), Coverage (factual recall), and Faithfulness (factual precision). Using the SiCF score, we select unlabeled dialogues with high-quality generated summaries to train summarization models. Comprehensive experiments on three public datasets demonstrate the effectiveness of SiCF scores in uncertainty estimation and semi-supervised learning for dialogue summarization tasks. Our code is available at \url{https://github.com/amazon-science/summarization-sicf-score}.

📄 PDF Abstract BibTeX arXiv:2403.04073

Code (1)

amazon-science/summarization-sicf-score 공식 구현 pytorch

Tasks

Abstractive Text SummarizationNatural Language Understanding

Methods 이 논문이 사용한 방법론

Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Concatenated Skip Connection A Concatenated Skip Connection is a type of skip connection that seeks to reuse features by concatenating them to new layers, allowing more information to be retained from…
U-Net 설명 없음
Focus 설명 없음
SSDS The method exploits the finding that high correlation of segmentation performance among each U-Net's decoder layer -- with discriminative layer attached -- tends to have higher…

Similar Papers 제목 키워드 기반

Simple Conversational Data Augmentation for Semi-supervised Abstractive Dialogue Summarization

2021-11-01 · EMNLP 2021 11 · Jiaao Chen, Diyi Yang

Abstractive conversation summarization has received growing attention while most current state-of-the-art summarization models heavily rely on human-annotated summaries. To reduce the dependence on labeled summaries, in …

Abstractive Dialogue SummarizationConversation SummarizationData Augmentation

Unsupervised Abstractive Dialogue Summarization for Tete-a-Tetes

2020-09-15 · Xinyuan Zhang, Ruiyi Zhang, Manzil Zaheer, Amr Ahmed

High-quality dialogue-summary paired data is expensive to produce and domain-sensitive, making abstractive dialogue summarization a challenging task. In this work, we propose the first unsupervised abstractive dialogue s…

Abstractive Dialogue Summarizationdialogue summarySentenceText Summarization

Enhancing Semantic Understanding with Self-supervised Methods for Abstractive Dialogue Summarization

2022-09-01 · Hyunjae Lee, Jaewoong Yun, Hyunjin Choi, Seongho Joe 외

Contextualized word embeddings can lead to state-of-the-art performances in natural language understanding. Recently, a pre-trained deep contextualized text encoder such as BERT has shown its potential in improving natur…

Abstractive Dialogue SummarizationAbstractive Text SummarizationArticlesDecoder+5

Unsupervised Abstractive Dialogue Summarization with Word Graphs and POV Conversion

2022-05-26 · WIT (ACL) 2022 5 · Seongmin Park, Jihwa Lee

We advance the state-of-the-art in unsupervised abstractive dialogue summarization by utilizing multi-sentence compression graphs. Starting from well-founded assumptions about word graphs, we present simple but reliable …

Abstractive Dialogue SummarizationRerankingSentenceSentence Compression

SAMSum Corpus: A Human-annotated Dialogue Dataset for Abstractive Summarization

2019-11-27 · WS 2019 11 · Bogdan Gliwa, Iwona Mochol, Maciej Biesek, Aleksander Wawer

This paper introduces the SAMSum Corpus, a new dataset with abstractive dialogue summaries. We investigate the challenges it poses for automated summarization by testing several models and comparing their results with th…

Abstractive Dialogue SummarizationAbstractive Text SummarizationArticlesdialogue summary