CovSumm: an unsupervised transformer-cum-graph-based hybrid document summarization model for CORD-19
The number of research articles published on COVID-19 has dramatically increased since the outbreak of the pandemic in November 2019. This absurd rate of productivity in research articles leads to information overload. It has increasingly become urgent for researchers and medical associations to stay up to date on the latest COVID-19 studies. To address information overload in COVID-19 scientific literature, the study presents a novel hybrid model named CovSumm, an unsupervised graph-based hybrid approach for single-document summarization, that is evaluated on the CORD-19 dataset. We have tested the proposed methodology on the scientific papers in the database dated from January 1, 2021 to December 31, 2021, consisting of 840 documents in total. The proposed text summarization is a hybrid of two distinctive extractive approaches (1) GenCompareSum (transformer-based approach) and (2) TextRank (graph-based approach). The sum of scores generated by both methods is used to rank the sentences for generating the summary. On the CORD-19, the recall-oriented understudy for gisting evaluation (ROUGE) score metric is used to compare the performance of the CovSumm model with various state-of-the-art techniques. The proposed method achieved the highest scores of ROUGE-1: 40.14%, ROUGE-2: 13.25%, and ROUGE-L: 36.32%. The proposed hybrid approach shows improved performance on the CORD-19 dataset when compared to existing unsupervised text summarization methods.
Code (0)
등록된 구현이 없습니다.
Tasks
ArticlesDocument SummarizationExtractive Text SummarizationText SummarizationUnsupervised Text SummarizationSimilar Papers 제목 키워드 기반
Unsupervised Extractive Summarization by Pre-training Hierarchical Transformers
Unsupervised extractive document summarization aims to select important sentences from a document without using labeled summaries during training. Existing methods are mostly graph-based with sentences as nodes and edge …
Document SummarizationExtractive Document SummarizationExtractive SummarizationExtractive Text Summarization+2Hybrid Topic-Semantic Labeling and Graph Embeddings for Unsupervised Legal Document Clustering
Legal documents pose unique challenges for text classification due to their domain-specific language and often limited labeled data. This paper proposes a hybrid approach for classifying legal texts by combining unsuperv…
Text ClassificationGraph EmbeddingHierarchical Graph Topic Modeling with Topic Tree-based Transformer
Textual documents are commonly connected in a hierarchical graph structure where a central document links to others with an exponentially growing connectivity. Though Hyperbolic Graph Neural Networks (HGNNs) excel at cap…
SpecificityTopic ModelsPre-training Meets Clustering: A Hybrid Extractive Multi-document Summarization Model
In this era where a large amount of information has flooded the Internet, manual extraction and consumption of relevant information is very difficult and time-consuming. Therefore, an automated document summarization too…
ClusteringDocument Summarizationdocument understandingExtractive Text Summarization+4Lexicon-Enriched Graph Modeling for Arabic Document Readability Prediction
We present a graph-based approach enriched with lexicons to predict document-level readability in Arabic, developed as part of the Constrained Track of the BAREC Shared Task 2025. Our system models each document as a sen…
Graph Neural Network