Modelling Temporal Document Sequences for Clinical ICD Coding
Past studies on the ICD coding problem focus on predicting clinical codes primarily based on the discharge summary. This covers only a small fraction of the notes generated during each hospital stay and leaves potential for improving performance by analysing all the available clinical notes. We propose a hierarchical transformer architecture that uses text across the entire sequence of clinical notes in each hospital stay for ICD coding, and incorporates embeddings for text metadata such as their position, time, and type of note. While using all clinical notes increases the quantity of data substantially, superconvergence can be used to reduce training costs. We evaluate the model on the MIMIC-III dataset. Our model exceeds the prior state-of-the-art when using only discharge summaries as input, and achieves further performance improvements when all clinical notes are used as input.
Code (0)
등록된 구현이 없습니다.
Tasks
AllPositionSimilar Papers 제목 키워드 기반
A Graph Enhanced Label Attention Model for ICD Coding from Clinical Text
Medical code assignment from clinical texts is a crucial task in the healthcare industry. Clinical texts are typically very long sequences and the number of possible labels are large, making this task quite challenging. …
TIMeSynC: Temporal Intent Modelling with Synchronized Context Encodings for Financial Service Applications
Users engage with financial services companies through multiple channels, often interacting with mobile applications, web platforms, call centers, and physical locations to service their accounts. The resulting interacti…
DecoderNMTPredictionRepresentation LearningFACTS: A Factored State-Space Framework For World Modelling
World modelling is essential for understanding and predicting the dynamics of complex systems by learning both spatial and temporal dependencies. However, current frameworks, such as Transformers and selective state-spac…
Multivariate Time Series ForecastingState Space ModelsTime Series ForecastingTemporal Cascade and Structural Modelling of EHRs for Granular Readmission Prediction
Predicting (1) when the next hospital admission occurs and (2) what will happen in the next admission about a patient by mining electronic health record (EHR) data can provide granular readmission predictions to assist c…
Decision MakingPoint ProcessesReadmission PredictionDeveloping a general-purpose clinical language inference model from a large corpus of clinical notes
Several biomedical language models have already been developed for clinical language inference. However, these models typically utilize general vocabularies and are trained on relatively small clinical corpora. We sought…
Causal InferenceDecoderDiagnosticRelation Extraction