paper-with-me

홈 › Papers

Attention-based Clinical Note Summarization

2021-04-18 · Neel Kanwal, Giuseppe Rizzo

In recent years, the trend of deploying digital systems in numerous industries has hiked. The health sector has observed an extensive adoption of digital systems and services that generate significant medical records. Electronic health records contain valuable information for prospective and retrospective analysis that is often not entirely exploited because of the complicated dense information storage. The crude purpose of condensing health records is to select the information that holds most characteristics of the original documents based on a reported disease. These summaries may boost diagnosis and save a doctor's time during a saturated workload situation like the COVID-19 pandemic. In this paper, we are applying a multi-head attention-based mechanism to perform extractive summarization of meaningful phrases on clinical notes. Our method finds major sentences for a summary by correlating tokens, segments, and positional embeddings of sentences in a clinical note. The model outputs attention scores that are statistically transformed to extract critical phrases for visualization on the heat-mapping tool and for human use.

📄 PDF Abstract BibTeX arXiv:2104.08942

Code (1)

NeelKanwal/BERTOLOGY-Based-Extractive-Summarization-for-Clinical-Notes 공식 구현

Tasks

Clinical Information RetreivalExtractive Summarization

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Residual Connection 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Adam 설명 없음

Similar Papers 제목 키워드 기반

Towards Automating Medical Scribing : Clinic Visit Dialogue2Note Sentence Alignment and Snippet Summarization

2021-06-01 · NAACL (NLPMC) 2021 6 · Wen-wai Yim, Meliha Yetisgen

Medical conversations from patient visits are routinely summarized into clinical notes for documentation of clinical care. The automatic creation of clinical note is particularly challenging given that it requires summar…

Sentence

Query-Guided Self-Supervised Summarization of Nursing Notes

2024-07-04 · Ya Gao, Hans Moen, Saila Koivusalo, Miika Koskinen 외

Nursing notes, an important part of Electronic Health Records (EHRs), track a patient's health during a care episode. Summarizing key information in nursing notes can help clinicians quickly understand patients' conditio…

Abstractive Text SummarizationDomain AdaptationHallucinationText Summarization

Content Reduction, Surprisal and Information Density Estimation for Long Documents

2023-09-12 · Shaoxiong Ji, Wei Sun, Pekka Marttinen

Many computational linguistic methods have been proposed to study the information content of languages. We consider two interesting research questions: 1) how is information distributed over long documents, and 2) how do…

Density EstimationText Summarization

Extractive Summarization of EHR Discharge Notes

2018-10-26 · Emily Alsentzer, Anne Kim

Patient summarization is essential for clinicians to provide coordinated care and practice effective communication. Automated summarization has the potential to save time, standardize notes, aid clinical decision making,…

Decision MakingExtractive Summarization

A Novel System for Extractive Clinical Note Summarization using EHR Data

2019-06-01 · WS 2019 6 · Jennifer Liang, Ching-Huei Tsou, Ananya Poddar

While much data within a patient{'}s electronic health record (EHR) is coded, crucial information concerning the patient{'}s care and management remain buried in unstructured clinical notes, making it difficult and time-…

Extractive Text SummarizationManagementSentenceText Summarization