Medical Knowledge Embedding Based on Recursive Neural Network for Multi-Disease Diagnosis
The representation of knowledge based on first-order logic captures the richness of natural language and supports multiple probabilistic inference models. Although symbolic representation enables quantitative reasoning with statistical probability, it is difficult to utilize with machine learning models as they perform numerical operations. In contrast, knowledge embedding (i.e., high-dimensional and continuous vectors) is a feasible approach to complex reasoning that can not only retain the semantic information of knowledge but also establish the quantifiable relationship among them. In this paper, we propose recursive neural knowledge network (RNKN), which combines medical knowledge based on first-order logic with recursive neural network for multi-disease diagnosis. After RNKN is efficiently trained from manually annotated Chinese Electronic Medical Records (CEMRs), diagnosis-oriented knowledge embeddings and weight matrixes are learned. Experimental results verify that the diagnostic accuracy of RNKN is superior to that of some classical machine learning models and Markov logic network (MLN). The results also demonstrate that the more explicit the evidence extracted from CEMRs is, the better is the performance achieved. RNKN gradually exhibits the interpretation of knowledge embeddings as the number of training epochs increases.
Code (0)
등록된 구현이 없습니다.
Tasks
BIG-bench Machine LearningDiagnosticSimilar Papers 제목 키워드 기반
Towards Knowledge-Infused Automated Disease Diagnosis Assistant
With the advancement of internet communication and telemedicine, people are increasingly turning to the web for various healthcare activities. With an ever-increasing number of diseases and symptoms, diagnosing patients …
DiagnosticGraph AttentionKnowledge Graph EmbeddingsKnowledge Graph Embeddings for Multi-Lingual Structured Representations of Radiology Reports
The way we analyse clinical texts has undergone major changes over the last years. The introduction of language models such as BERT led to adaptations for the (bio)medical domain like PubMedBERT and ClinicalBERT. These m…
ClassificationGraph Embeddingimage-classificationImage Classification+2Towards Ontology-Enhanced Representation Learning for Large Language Models
Taking advantage of the widespread use of ontologies to organise and harmonize knowledge across several distinct domains, this paper proposes a novel approach to improve an embedding-Large Language Model (embedding-LLM) …
Contrastive LearningLanguage ModelingLanguage ModellingLarge Language Model+1NormCo: Deep Disease Normalization for Biomedical Knowledge Base Construction
Biomedical knowledge bases are crucial in modern data-driven biomedical sciences, but auto-mated biomedical knowledge base construction remains challenging. In this paper, we consider the problem of disease entity normal…
Knowledge Base ConstructionWord EmbeddingsKnowledge Graph-based Neurodegenerative Diseases and Diet Relationship Discovery
To date, there are no effective treatments for most neurodegenerative diseases. However, certain foods may be associated with these diseases and bring an opportunity to prevent or delay neurodegenerative progression. Our…
Literature Mining