Leveraging knowledge graphs to update scientific word embeddings using latent semantic imputation
The most interesting words in scientific texts will often be novel or rare. This presents a challenge for scientific word embedding models to determine quality embedding vectors for useful terms that are infrequent or newly emerging. We demonstrate how \gls{lsi} can address this problem by imputing embeddings for domain-specific words from up-to-date knowledge graphs while otherwise preserving the original word embedding model. We use the MeSH knowledge graph to impute embedding vectors for biomedical terminology without retraining and evaluate the resulting embedding model on a domain-specific word-pair similarity task. We show that LSI can produce reliable embedding vectors for rare and OOV terms in the biomedical domain.
Code (0)
등록된 구현이 없습니다.
Tasks
ImputationKnowledge GraphsWord EmbeddingsSimilar Papers 제목 키워드 기반
Unsupervised Construction of Knowledge Graphs From Text and Code
The scientific literature is a rich source of information for data mining with conceptual knowledge graphs; the open science movement has enriched this literature with complementary source code that implements scientific…
ClusteringDimensionality ReductionKnowledge GraphsSpecificity+1FineMolTex: Towards Fine-grained Molecular Graph-Text Pre-training
Understanding molecular structure and related knowledge is crucial for scientific research. Recent studies integrate molecular graphs with their textual descriptions to enhance molecular representation learning. However,…
Drug Discoverymolecular representationRepresentation LearningCogMG: Collaborative Augmentation Between Large Language Model and Knowledge Graph
Large language models have become integral to question-answering applications despite their propensity for generating hallucinations and factually inaccurate content. Querying knowledge graphs to reduce hallucinations in…
Knowledge Graph CompletionKnowledge GraphsLanguage ModelingLanguage Modelling+2Mixture of Knowledge Minigraph Agents for Literature Review Generation
Literature reviews play a crucial role in scientific research for understanding the current state of research, identifying gaps, and guiding future studies on specific topics. However, the process of conducting a compreh…
Review GenerationScienceMeter: Tracking Scientific Knowledge Updates in Language Models
Large Language Models (LLMs) are increasingly used to support scientific research, but their knowledge of scientific advancements can quickly become outdated. We introduce ScienceMeter, a new framework for evaluating sci…