paper-with-me

홈 › Papers

Optimal path for Biomedical Text Summarization Using Pointer GPT

2024-03-22 · Hyunkyung Han, Jaesik Choi

Biomedical text summarization is a critical tool that enables clinicians to effectively ascertain patient status. Traditionally, text summarization has been accomplished with transformer models, which are capable of compressing long documents into brief summaries. However, transformer models are known to be among the most challenging natural language processing (NLP) tasks. Specifically, GPT models have a tendency to generate factual errors, lack context, and oversimplify words. To address these limitations, we replaced the attention mechanism in the GPT model with a pointer network. This modification was designed to preserve the core values of the original text during the summarization process. The effectiveness of the Pointer-GPT model was evaluated using the ROUGE score. The results demonstrated that Pointer-GPT outperformed the original GPT model. These findings suggest that pointer networks can be a valuable addition to EMR systems and can provide clinicians with more accurate and informative summaries of patient medical records. This research has the potential to usher in a new paradigm in EMR systems and to revolutionize the way that clinicians interact with patient medical records.

📄 PDF Abstract BibTeX arXiv:2404.08654

Code (0)

등록된 구현이 없습니다.

Tasks

Text Summarization

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Multi-Head Attention 설명 없음
Cosine Annealing Cosine Annealing is a type of learning rate schedule that has the effect of starting with a large learning rate that is relatively rapidly decreased to a minimum value before…
Linear Warmup With Cosine Annealing Linear Warmup With Cosine Annealing is a learning rate schedule where we increase the learning rate linearly for $n$ updates and then anneal according to a cosine schedule…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Similar Papers 제목 키워드 기반

A more abstractive summarization model

2020-02-25 · Satyaki Chakraborty, Xinya Li, Sayak Chakraborty

Pointer-generator network is an extremely popular method of text summarization. More recent works in this domain still build on top of the baseline pointer generator by augmenting a content selection phase, or by decompo…

Abstractive Text SummarizationDecoderLanguage ModelingLanguage Modelling+2

Neural Abstractive Text Summarization and Fake News Detection

2019-03-24 · Soheil Esmaeilzadeh, Gao Xian Peh, Angela Xu

In this work, we study abstractive text summarization by exploring different models such as LSTM-encoder-decoder with attention, pointer-generator networks, coverage mechanisms, and transformers. Upon extensive and caref…

Abstractive Text SummarizationArticlesClassificationDecoder+3

Point-less: More Abstractive Summarization with Pointer-Generator Networks

2019-04-18 · Freek Boutkan, Jorn Ranzijn, David Rau, Eelco van der Wel

The Pointer-Generator architecture has shown to be a big improvement for abstractive summarization seq2seq models. However, the summaries produced by this model are largely extractive as over 30% of the generated sentenc…

Abstractive Text Summarization

Pointer over Attention: An Improved Bangla Text Summarization Approach Using Hybrid Pointer Generator Network

2021-11-19 · Nobel Dhar, Gaurob Saha, Prithwiraj Bhattacharjee, Avi Mallick 외

Despite the success of the neural sequence-to-sequence model for abstractive text summarization, it has a few shortcomings, such as repeating inaccurate factual details and tending to repeat themselves. We propose a hybr…

Abstractive Text SummarizationArticlesText Summarization

Improving Latent Alignment in Text Summarization by Generalizing the Pointer Generator

2019-11-01 · IJCNLP 2019 11 · Xiaoyu Shen, Yang Zhao, Hui Su, Dietrich Klakow

Pointer Generators have been the de facto standard for modern summarization systems. However, this architecture faces two major drawbacks: Firstly, the pointer is limited to copying the exact words while ignoring possibl…

Text SummarizationWord Alignment