paper-with-me

홈 › Papers

Improving Extraction of Clinical Event Contextual Properties from Electronic Health Records: A Comparative Study

2024-08-30 · Shubham Agarwal, Thomas Searle, Mart Ratas, Anthony Shek, James Teo, Richard Dobson

Electronic Health Records are large repositories of valuable clinical data, with a significant portion stored in unstructured text format. This textual data includes clinical events (e.g., disorders, symptoms, findings, medications and procedures) in context that if extracted accurately at scale can unlock valuable downstream applications such as disease prediction. Using an existing Named Entity Recognition and Linking methodology, MedCAT, these identified concepts need to be further classified (contextualised) for their relevance to the patient, and their temporal and negated status for example, to be useful downstream. This study performs a comparative analysis of various natural language models for medical text classification. Extensive experimentation reveals the effectiveness of transformer-based language models, particularly BERT. When combined with class imbalance mitigation techniques, BERT outperforms Bi-LSTM models by up to 28% and the baseline BERT model by up to 16% for recall of the minority classes. The method has been implemented as part of CogStack/MedCAT framework and made available to the community for further research.

📄 PDF Abstract BibTeX arXiv:2408.17181

Code (0)

등록된 구현이 없습니다.

Tasks

Disease Predictionnamed-entity-recognitionNamed Entity Recognitiontext-classificationText Classification

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Attention 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Adam 설명 없음
Weight Decay 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

Systematic Comparative Analysis of Large Pretrained Language Models on Contextualized Medication Event Extraction

2025-09-23 · Tariq Abdul-Quddoos, Xishuang Dong, Lijun Qian arxiv

Attention-based models have become the leading approach in modeling medical language for Natural Language Processing (NLP) in clinical notes. These models outperform traditional techniques by effectively capturing contex…

Information ExtractionEvent Extraction

End-to-end Clinical Event Extraction from Chinese Electronic Health Record

2022-08-19 · Wei Feng, Ruochen Huang, Yun Yu, Huiting Sun 외

Event extraction is an important work of medical text processing. According to the complex characteristics of medical text annotation, we use the end-to-end event extraction model to enhance the output formatting informa…

Event ExtractionPositiontext annotation

Evaluation of Transfer Learning for Adverse Drug Event (ADE) and Medication Entity Extraction

2020-11-01 · EMNLP (ClinicalNLP) 2020 11 · Sankaran Narayanan, Kaivalya Mannam, Sreeranga P Rajan, P Venkat Rangan

We evaluate several biomedical contextual embeddings (based on BERT, ELMo, and Flair) for the detection of medication entities such as Drugs and Adverse Drug Events (ADE) from Electronic Health Records (EHR) using the 20…

Language ModelingLanguage ModellingSentenceTransfer Learning

Negation detection in Dutch clinical texts: an evaluation of rule-based and machine learning methods

2022-09-01 · Bram van Es, Leon C. Reteig, Sander C. Tan, Marijn Schraagen 외

As structured data are often insufficient, labels need to be extracted from free text in electronic health records when developing models for clinical information retrieval and decision support systems. One of the most i…

Information RetrievalNegationNegation DetectionRetrieval

Phenotyping of Clinical Notes with Improved Document Classification Models Using Contextualized Neural Language Models

2019-10-30 · Andriy Mulyar, Elliot Schumacher, Masoud Rouhizadeh, Mark Dredze

Clinical notes contain an extensive record of a patient's health status, such as smoking status or the presence of heart conditions. However, this detail is not replicated within the structured data of electronic health …

Document ClassificationGeneral Classification