paper-with-me

홈 › Papers

SKT5SciSumm -- Revisiting Extractive-Generative Approach for Multi-Document Scientific Summarization

2024-02-27 · Huy Quoc To, Ming Liu, Guangyan Huang, Hung-Nghiep Tran, Andr'e Greiner-Petter, Felix Beierle, Akiko Aizawa

Summarization for scientific text has shown significant benefits both for the research community and human society. Given the fact that the nature of scientific text is distinctive and the input of the multi-document summarization task is substantially long, the task requires sufficient embedding generation and text truncation without losing important information. To tackle these issues, in this paper, we propose SKT5SciSumm - a hybrid framework for multi-document scientific summarization (MDSS). We leverage the Sentence-Transformer version of Scientific Paper Embeddings using Citation-Informed Transformers (SPECTER) to encode and represent textual sentences, allowing for efficient extractive summarization using k-means clustering. We employ the T5 family of models to generate abstractive summaries using extracted sentences. SKT5SciSumm achieves state-of-the-art performance on the Multi-XScience dataset. Through extensive experiments and evaluation, we showcase the benefits of our model by using less complicated models to achieve remarkable results, thereby highlighting its potential in advancing the field of multi-document summarization for scientific text.

📄 PDF Abstract BibTeX arXiv:2402.17311

Code (0)

등록된 구현이 없습니다.

Tasks

Document SummarizationExtractive SummarizationMulti-Document SummarizationSentence

Methods 이 논문이 사용한 방법론

Gated Linear Unit A Gated Linear Unit, or GLU computes: $$ \mathrm{GLU}(a, b) = a \otimes \sigma(b) $$ It is used in natural language processing architectures, for example the Gated CNN,…
Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Inverse Square Root Schedule Inverse Square Root is a learning rate schedule 1 / $\sqrt{\max\left(n, k\right)}$ where $n$ is the current training iteration and $k$ is the number of warm-up steps. This…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Similar Papers 제목 키워드 기반

CIST@CL-SciSumm 2020, LongSumm 2020: Automatic Scientific Document Summarization

2020-11-01 · EMNLP (sdp) 2020 11 · Lei LI, Yang Xie, Wei Liu, Yinan Liu 외

Our system participates in two shared tasks, CL-SciSumm 2020 and LongSumm 2020. In the CL-SciSumm shared task, based on our previous work, we apply more machine learning methods on position features and content features …

Abstractive Text SummarizationDocument SummarizationExtractive SummarizationPosition+1

Overview and Results: CL-SciSumm Shared Task 2019

2019-07-23 · Muthu Kumar Chandrasekaran, Michihiro Yasunaga, Dragomir Radev, Dayne Freitag 외

The CL-SciSumm Shared Task is the first medium-scale shared task on scientific document summarization in the computational linguistics~(CL) domain. In 2019, it comprised three tasks: (1A) identifying relationships betwee…

Document SummarizationInformation RetrievalRetrievalScientific Document Summarization

1A-Team / Martin-Luther-Universität Halle-Wittenberg@CLSciSumm 20

2020-11-01 · EMNLP (sdp) 2020 11 · Artur Jurk, Maik Boltze, Georg Keller, Lorna Ulbrich 외

This document demonstrates our groups approach to the CL-SciSumm shared task 2020. There are three tasks in CL-SciSumm 2020. In Task 1a, we apply a Siamese neural network to identify the spans of text in the reference pa…

SciSummPip: An Unsupervised Scientific Paper Summarization Pipeline

2020-10-19 · Jiaxin Ju, Ming Liu, Longxiang Gao, Shirui Pan

The Scholarly Document Processing (SDP) workshop is to encourage more efforts on natural language understanding of scientific task. It contains three shared tasks and we participate in the LongSumm shared task. In this p…

ClusteringGraph Clusteringgraph constructionLanguage Modeling+5

Monash-Summ@LongSumm 20 SciSummPip: An Unsupervised Scientific Paper Summarization Pipeline

2020-11-01 · EMNLP (sdp) 2020 11 · Jiaxin Ju, Ming Liu, Longxiang Gao, Shirui Pan

The Scholarly Document Processing (SDP) workshop is to encourage more efforts on natural language understanding of scientific task. It contains three shared tasks and we participate in the LongSumm shared task. In this p…

Graph Clusteringgraph constructionLanguage ModelingLanguage Modelling+4