paper-with-me

홈 › Papers

Suicide Phenotyping from Clinical Notes in Safety-Net Psychiatric Hospital Using Multi-Label Classification with Pre-Trained Language Models

2024-09-27 · Zehan Li, Yan Hu, Scott Lane, Salih Selek, Lokesh Shahani, Rodrigo Machado-Vieira, Jair Soares, Hua Xu, Hongfang Liu, Ming Huang

Accurate identification and categorization of suicidal events can yield better suicide precautions, reducing operational burden, and improving care quality in high-acuity psychiatric settings. Pre-trained language models offer promise for identifying suicidality from unstructured clinical narratives. We evaluated the performance of four BERT-based models using two fine-tuning strategies (multiple single-label and single multi-label) for detecting coexisting suicidal events from 500 annotated psychiatric evaluation notes. The notes were labeled for suicidal ideation (SI), suicide attempts (SA), exposure to suicide (ES), and non-suicidal self-injury (NSSI). RoBERTa outperformed other models using multiple single-label classification strategy (acc=0.86, F1=0.78). MentalBERT (acc=0.83, F1=0.74) also exceeded BioClinicalBERT (acc=0.82, F1=0.72) which outperformed BERT (acc=0.80, F1=0.70). RoBERTa fine-tuned with single multi-label classification further improved the model performance (acc=0.88, F1=0.81). The findings highlight that the model optimization, pretraining with domain-relevant data, and the single multi-label classification strategy enhance the model performance of suicide phenotyping. Keywords: EHR-based Phenotyping; Natural Language Processing; Secondary Use of EHR Data; Suicide Classification; BERT-based Model; Psychiatry; Mental Health

📄 PDF Abstract BibTeX arXiv:2409.18878

Code (0)

등록된 구현이 없습니다.

Tasks

ClassificationModel OptimizationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATION

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Multi-Head Attention 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Adam 설명 없음

Similar Papers 제목 키워드 기반

Neural Language Models with Distant Supervision to Identify Major Depressive Disorder from Clinical Notes

2021-04-19 · Bhavani Singh Agnikula Kshatriya, Nicolas A Nunez, Manuel Gardea- Resendez, Euijung Ryu 외

Major depressive disorder (MDD) is a prevalent psychiatric disorder that is associated with significant healthcare burden worldwide. Phenotyping of MDD can help early diagnosis and consequently may have significant advan…

BIG-bench Machine LearningEEGElectroencephalogram (EEG)Management+2

Multi-Label Classification with Generative AI Models in Healthcare: A Case Study of Suicidality and Risk Factors

2025-07-22 · Ming Huang, Zehan Li, Yan Hu, Wanjing Wang 외 arxiv

Suicide remains a pressing global health crisis, with over 720,000 deaths annually and millions more affected by suicide ideation (SI) and suicide attempts (SA). Early identification of suicidality-related factors (SrFs)…

Multi-Label ClassificationBinary Classification

An artificial intelligence framework for end-to-end rare disease phenotyping from clinical notes using large language models

2026-02-23 · Cathy Shyr, Yan Hu, Rory J. Tinker, Thomas A. Cassini 외 arxiv

Phenotyping is fundamental to rare disease diagnosis, but manual curation of structured phenotypes from clinical notes is labor-intensive and difficult to scale. Existing artificial intelligence approaches typically opti…

Cognitive network science quantifies feelings expressed in suicide letters and Reddit mental health communities

2021-10-28 · Simmi Marina Joseph, Salvatore Citraro, Virginia Morini, Giulio Rossetti 외

Writing messages is key to expressing feelings. This study adopts cognitive network science to reconstruct how individuals report their feelings in clinical narratives like suicide notes or mental health posts. We achiev…

Cross-Lingual Knowledge Transfer for Clinical Phenotyping

2022-08-03 · LREC 2022 6 · Jens-Michalis Papaioannou, Paul Grundmann, Betty van Aken, Athanasios Samaras 외

Clinical phenotyping enables the automatic extraction of clinical conditions from patient records, which can be beneficial to doctors and clinics worldwide. However, current state-of-the-art models are mostly applicable …

Transfer Learning