paper-with-me

Papers

Multi-modal Graph Learning over UMLS Knowledge Graphs

2023-07-10 · Manuel Burger, Gunnar Rätsch, Rita Kuznetsova

Clinicians are increasingly looking towards machine learning to gain insights about patient evolutions. We propose a novel approach named Multi-Modal UMLS Graph Learning (MMUGL) for learning meaningful representations of medical concepts using graph neural networks over knowledge graphs based on the unified medical language system. These representations are aggregated to represent entire patient visits and then fed into a sequence model to perform predictions at the granularity of multiple hospital visits of a patient. We improve performance by incorporating prior medical knowledge and considering multiple modalities. We compare our method to existing architectures proposed to learn representations at different granularities on the MIMIC-III dataset and show that our approach outperforms these methods. The results demonstrate the significance of multi-modal medical concept representations based on prior medical knowledge.

📄 PDF Abstract BibTeX arXiv:2307.04461

Code (1)

ratschlab/mmugl 공식 구현 pytorch

Tasks

Graph LearningKnowledge GraphsPredict clinical outcome

Similar Papers 제목 키워드 기반

Injecting Structured Biomedical Knowledge into Language Models: Continual Pretraining vs. GraphRAG

2026-04-03 · Jaafer Klila, Sondes Bannour Souihi, Rahma Boujelben, Nasredine Semmar 외 arxiv

The injection of domain-specific knowledge is crucial for adapting language models (LMs) to specialized fields such as biomedicine. While most current approaches rely on unstructured text corpora, this study explores two…

Continual PretrainingQuestion Answering

UmlsBERT: Clinical Domain Knowledge Augmentation of Contextual Embeddings Using the Unified Medical Language System Metathesaurus

2020-10-20 · NAACL 2021 4 · George Michalopoulos, Yuanxin Wang, Hussam Kaka, Helen Chen 외

Contextual word embedding models, such as BioBERT and Bio_ClinicalBERT, have achieved state-of-the-art results in biomedical natural language processing tasks by focusing their pre-training process on domain-specific cor…

named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)Natural Language Inference+2

Biomedical Event Extraction with Hierarchical Knowledge Graphs

2020-09-20 · Findings of the Association for Computational Linguistics 2020 · Kung-Hsiang Huang, Mu Yang, Nanyun Peng

Biomedical event extraction is critical in understanding biomolecular interactions described in scientific corpus. One of the main challenges is to identify nested structured events that are associated with non-indicativ…

Event ExtractionLanguage ModelingSentence

MedVQA-TREE: A Multimodal Reasoning and Retrieval Framework for Sarcopenia Prediction

2025-08-26 · Pardis Moradbeiki, Nasser Ghadiri, Sayed Jalal Zahabi, Uffe Kock Wiil 외 arxiv

Accurate sarcopenia diagnosis via ultrasound remains challenging due to subtle imaging cues, limited labeled data, and the absence of clinical context in most models. We propose MedVQA-TREE, a multimodal framework that i…

Multimodal ReasoningClinical KnowledgeSpatial Reasoning

CoRTEx: Contrastive Learning for Representing Terms via Explanations with Applications on Constructing Biomedical Knowledge Graphs

2023-12-13 · Huaiyuan Ying, Zhengyun Zhao, Yang Zhao, Sihang Zeng 외

Objective: Biomedical Knowledge Graphs play a pivotal role in various biomedical research domains. Concurrently, term clustering emerges as a crucial step in constructing these knowledge graphs, aiming to identify synony…

ClusteringContrastive LearningKnowledge GraphsWorld Knowledge