paper-with-me

Papers

The Effect of the Multi-Layer Text Summarization Model on the Efficiency and Relevancy of the Vector Space-based Information Retrieval

2020-04-18 · Ahmad Hussein Ababneh, Joan Lu, Qiang Xu

The massive upload of text on the internet creates a huge inverted index in information retrieval systems, which hurts their efficiency. The purpose of this research is to measure the effect of the Multi-Layer Similarity model of the automatic text summarization on building an informative and condensed invert index in the IR systems. To achieve this purpose, we summarized a considerable number of documents using the Multi-Layer Similarity model, and we built the inverted index from the automatic summaries that were generated from this model. A series of experiments were held to test the performance in terms of efficiency and relevancy. The experiments include comparisons with three existing text summarization models; the Jaccard Coefficient Model, the Vector Space Model, and the Latent Semantic Analysis model. The experiments examined three groups of queries with manual and automatic relevancy assessment. The positive effect of the Multi-Layer Similarity in the efficiency of the IR system was clear without noticeable loss in the relevancy results. However, the evaluation showed that the traditional statistical models without semantic investigation failed to improve the information retrieval efficiency. Comparing with the previous publications that addressed the use of summaries as a source of the index, the relevancy assessment of our work was higher, and the Multi-Layer Similarity retrieval constructed an inverted index that was 58% smaller than the main corpus inverted index.

📄 PDF Abstract BibTeX arXiv:2004.13136

Code (0)

등록된 구현이 없습니다.

Tasks

Information RetrievalRetrievalText Summarization

Similar Papers 제목 키워드 기반

HEGEL: Hypergraph Transformer for Long Document Summarization

2022-10-09 · Haopeng Zhang, Xiao Liu, Jiawei Zhang

Extractive summarization for long documents is challenging due to the extended structured input context. The long-distance sentence dependency hinders cross-sentence relations modeling, the critical step of extractive su…

Document SummarizationExtractive SummarizationSentence

IUTEAM1 at MEDIQA-Chat 2023: Is simple fine tuning effective for multilayer summarization of clinical conversations?

2023-06-07 · Dhananjay Srivastava

Clinical conversation summarization has become an important application of Natural language Processing. In this work, we intend to analyze summarization model ensembling approaches, that can be utilized to improve the ov…

Conversation Summarization

Parameter-Efficient Fine-Tuning with Layer Pruning on Free-Text Sequence-to-Sequence Modeling

2023-05-15 · Yunqi Zhu, Xuebing Yang, Yuanyuan Wu, Wensheng Zhang

The increasing size of language models raises great research interests in parameter-efficient fine-tuning such as LoRA that freezes the pre-trained model, and injects small-scale trainable parameters for multiple downstr…

Dialogue GenerationGPUparameter-efficient fine-tuningQuestion Answering

Extractive Multi-document Summarization Using Multilayer Networks

2017-11-07 · Jorge V. Tohalino, Diego R. Amancio

Huge volumes of textual information has been produced every single day. In order to organize and understand such large datasets, in recent years, summarization techniques have become popular. These techniques aims at fin…

Document SummarizationMulti-Document Summarization

Learning to Prioritize: Precision-Driven Sentence Filtering for Long Text Summarization

2021-10-16 · ACL ARR October 2021 10 · Anonymous

Neural text summarization has shown great potential in recent years. However, current state-of-the-art summarization models are limited by their maximum input length, posing a challenge to summarize longer texts comprehe…

ArticlesSentenceText Summarization