Papers Abstractive Text Summarization
“Abstractive Text Summarization” 태그가 달린 논문 852편 · 필터 해제
RST-LoRA: A Discourse-Aware Low-Rank Adaptation for Long Document Abstractive Summarization
For long document summarization, discourse structure is important to discern the key content of the text and the differences in importance level between sentences. Unfortunately, the integration of rhetorical structure t…
Abstractive Text SummarizationDocument Summarizationparameter-efficient fine-tuningFIZZ: Factual Inconsistency Detection by Zoom-in Summary and Zoom-out Document
Through the advent of pre-trained language models, there have been notable advancements in abstractive summarization systems. Simultaneously, a considerable number of novel methods for evaluating factual consistency in a…
Abstractive Text SummarizationMitigating Hallucination in Abstractive Summarization with Domain-Conditional Mutual Information
A primary challenge in abstractive summarization is hallucination -- the phenomenon where a model generates plausible text that is absent in the source text. We hypothesize that the domain (or topic) of the source text t…
Abstractive Text SummarizationHallucinationNeural Sequence-to-Sequence Modeling with Attention by Leveraging Deep Learning Architectures for Enhanced Contextual Understanding in Abstractive Text Summarization
Automatic text summarization (TS) plays a pivotal role in condensing large volumes of information into concise, coherent summaries, facilitating efficient information retrieval and comprehension. This paper presents a no…
Abstractive Text SummarizationInformation Retrievaltext similarityText Summarization+1Assisting humans in complex comparisons: automated information comparison at scale
Generative Large Language Models enable efficient analytics across knowledge domains, rivalling human experts in information comparisons. However, the applications of LLMs for information comparisons face scalability cha…
Abstractive Text SummarizationRetrievalRetrieval-augmented Generationtext similaritySelect and Summarize: Scene Saliency for Movie Script Summarization
Abstractive summarization for long-form narrative texts such as movie scripts is challenging due to the computational and memory constraints of current language models. A movie script typically comprises a large number o…
Abstractive Text SummarizationLong-Form Narrative SummarizationFrom News to Summaries: Building a Hungarian Corpus for Extractive and Abstractive Summarization
Training summarization models requires substantial amounts of training data. However for less resourceful languages like Hungarian, openly available models and datasets are notably scarce. To address this gap our paper i…
Abstractive Text SummarizationExtractive SummarizationSentenceSentence SimilarityLexAbSumm: Aspect-based Summarization of Legal Decisions
Legal professionals frequently encounter long legal judgments that hold critical insights for their work. While recent advances have led to automated summarization solutions for legal documents, they typically provide ge…
Abstractive Text SummarizationImproving Sequence-to-Sequence Models for Abstractive Text Summarization Using Meta Heuristic Approaches
As human society transitions into the information age, reduction in our attention span is a contingency, and people who spend time reading lengthy news articles are decreasing rapidly and the need for succinct informatio…
Abstractive Text SummarizationArticlesDecoderText SummarizationPARAMANU-AYN: Pretrain from scratch or Continual Pretraining of LLMs for Legal Domain Adaptation?
In this paper, we present Paramanu-Ayn, a collection of legal language models trained exclusively on Indian legal case documents. This 97-million-parameter Auto-Regressive (AR) decoder-only model was pretrained from scra…
Abstractive Text SummarizationContinual PretrainingDecoderDomain Adaptation+5From Instructions to Constraints: Language Model Alignment with Automatic Constraint Verification
User alignment is crucial for adapting general-purpose language models (LMs) to downstream tasks, but human annotations are often not available for all types of instructions, especially those with customized constraints.…
Abstractive Text SummarizationEntity TypingLanguage ModelingLanguage Modelling+1Few-Shot Cross-Lingual Transfer for Prompting Large Language Models in Low-Resource Languages
Large pre-trained language models (PLMs) are at the forefront of advances in Natural Language Processing. One widespread use case of PLMs is "prompting" - or in-context learning - where a user provides a description of a…
Abstractive Text SummarizationCross-Lingual TransferIn-Context LearningMachine Translation+3ACLSum: A New Dataset for Aspect-based Summarization of Scientific Publications
Extensive efforts in the past have been directed toward the development of summarization datasets. However, a predominant number of these resources have been (semi)-automatically generated, typically through web data cra…
Abstractive Text SummarizationSemi-Supervised Dialogue Abstractive Summarization via High-Quality Pseudolabel Selection
Semi-supervised dialogue summarization (SSDS) leverages model-generated summaries to reduce reliance on human-labeled data and improve the performance of summarization models. While addressing label noise, previous works…
Abstractive Text SummarizationNatural Language UnderstandingA Second Look on BASS -- Boosting Abstractive Summarization with Unified Semantic Graphs -- A Replication Study
We present a detailed replication study of the BASS framework, an abstractive summarization system based on the notion of Unified Semantic Graphs. Our investigation includes challenges in replicating key components and a…
Abstractive Text SummarizationVBART: The Turkish LLM
We present VBART, the first Turkish sequence-to-sequence Large Language Models (LLMs) pre-trained on a large corpus from scratch. VBART are compact LLMs based on good ideas leveraged from BART and mBART models and come i…
Abstractive Text SummarizationQuestion AnsweringQuestion GenerationQuestion-Generation+2EROS: Entity-Driven Controlled Policy Document Summarization
Privacy policy documents have a crucial role in educating individuals about the collection, usage, and protection of users' personal data by organizations. However, they are notorious for their lengthy, complex, and conv…
Abstractive Text SummarizationDocument SummarizationLayer-wise Regularized Dropout for Neural Language Models
Among the various pre-trained neural language models that are popular today, dropout is already an indispensable regularization technique. To solve the inconsistency between training and inference caused by the randomnes…
Abstractive Text SummarizationMachine TranslationNatural Language UnderstandingEntity-level Factual Adaptiveness of Fine-tuning based Abstractive Summarization Models
Abstractive summarization models often generate factually inconsistent content particularly when the parametric knowledge of the model conflicts with the knowledge in the input document. In this paper, we analyze the rob…
Abstractive Text SummarizationContrastive LearningcounterfactualData AugmentationAnalysis of Multidomain Abstractive Summarization Using Salience Allocation
This paper explores the realm of abstractive text summarization through the lens of the SEASON (Salience Allocation as Guidance for Abstractive SummarizatiON) technique, a model designed to enhance summarization by lever…
Abstractive Text SummarizationArticlesEvent-Driven TradingText Summarization