paper-with-me

홈 › Papers

Generating a Structured Summary of Numerous Academic Papers: Dataset and Method

2023-02-09 · Shuaiqi Liu, Jiannong Cao, Ruosong Yang, Zhiyuan Wen

Writing a survey paper on one research topic usually needs to cover the salient content from numerous related papers, which can be modeled as a multi-document summarization (MDS) task. Existing MDS datasets usually focus on producing the structureless summary covering a few input documents. Meanwhile, previous structured summary generation works focus on summarizing a single document into a multi-section summary. These existing datasets and methods cannot meet the requirements of summarizing numerous academic papers into a structured summary. To deal with the scarcity of available data, we propose BigSurvey, the first large-scale dataset for generating comprehensive summaries of numerous academic papers on each topic. We collect target summaries from more than seven thousand survey papers and utilize their 430 thousand reference papers' abstracts as input documents. To organize the diverse content from dozens of input documents and ensure the efficiency of processing long text sequences, we propose a summarization method named category-based alignment and sparse transformer (CAST). The experimental results show that our CAST method outperforms various advanced summarization methods.

📄 PDF Abstract BibTeX arXiv:2302.04580

Code (1)

stevenlau6/bigsurvey 공식 구현

Tasks

Document SummarizationMulti-Document SummarizationSurvey

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Multi-Head Attention 설명 없음
Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Adam 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

Factored Verification: Detecting and Reducing Hallucination in Summaries of Academic Papers

2023-10-16 · Charlie George, Andreas Stuhlmüller

Hallucination plagues even frontier LLMs--but how bad is it really for summarizing academic papers? We evaluate Factored Verification, a simple automated method for detecting hallucinations in abstractive summaries. This…

16kHallucination

NLP-AKG: Few-Shot Construction of NLP Academic Knowledge Graph Based on LLM

2025-02-20 · Jiayin Lan, Jiaqi Li, Baoxin Wang, Ming Liu 외

Large language models (LLMs) have been widely applied in question answering over scientific research papers. To enhance the professionalism and accuracy of responses, many studies employ external knowledge augmentation. …

graph constructionQuestion Answering

S2ORC: The Semantic Scholar Open Research Corpus

2019-11-07 · ACL 2020 6 · Kyle Lo, Lucy Lu Wang, Mark Neumann, Rodney Kinney 외

We introduce S2ORC, a large corpus of 81.1M English-language academic papers spanning many academic disciplines. The corpus consists of rich metadata, paper abstracts, resolved bibliographic references, as well as struct…

Language Modelling

Leveraging Large Language Models for Comparative Literature Summarization with Reflective Incremental Mechanisms

2024-12-03 · Fernando Gabriela Garcia, Spencer Burns, Harrison Fuller

In this paper, we introduce ChatCite, a novel method leveraging large language models (LLMs) for generating comparative literature summaries. The ability to summarize research papers with a focus on key comparisons betwe…

Review Generation

Hierarchical Tree-structured Knowledge Graph For Academic Insight Survey

2024-02-07 · Jinghong Li, Huy Phan, Wen Gu, Koichi Ota 외

Research surveys have always posed a challenge for beginner researchers who lack of research training. These researchers struggle to understand the directions within their research topic, and the discovery of new researc…

Knowledge GraphsRecommendation SystemsSurveytext similarity