paper-with-me

Papers

Leveraging knowledge graphs to update scientific word embeddings using latent semantic imputation

2022-10-27 · Jason Hoelscher-Obermaier, Edward Stevinson, Valentin Stauber, Ivaylo Zhelev, Victor Botev, Ronin Wu, Jeremy Minton

The most interesting words in scientific texts will often be novel or rare. This presents a challenge for scientific word embedding models to determine quality embedding vectors for useful terms that are infrequent or newly emerging. We demonstrate how \gls{lsi} can address this problem by imputing embeddings for domain-specific words from up-to-date knowledge graphs while otherwise preserving the original word embedding model. We use the MeSH knowledge graph to impute embedding vectors for biomedical terminology without retraining and evaluate the resulting embedding model on a domain-specific word-pair similarity task. We show that LSI can produce reliable embedding vectors for rare and OOV terms in the biomedical domain.

📄 PDF Abstract BibTeX arXiv:2210.15358

Code (0)

등록된 구현이 없습니다.

Tasks

ImputationKnowledge GraphsWord Embeddings

Similar Papers 제목 키워드 기반

Unsupervised Construction of Knowledge Graphs From Text and Code

2019-08-25 · Kun Cao, James Fairbanks

The scientific literature is a rich source of information for data mining with conceptual knowledge graphs; the open science movement has enriched this literature with complementary source code that implements scientific…

ClusteringDimensionality ReductionKnowledge GraphsSpecificity+1

FineMolTex: Towards Fine-grained Molecular Graph-Text Pre-training

2024-09-21 · Yibo Li, Yuan Fang, Mengmei Zhang, Chuan Shi

Understanding molecular structure and related knowledge is crucial for scientific research. Recent studies integrate molecular graphs with their textual descriptions to enhance molecular representation learning. However,…

Drug Discoverymolecular representationRepresentation Learning

CogMG: Collaborative Augmentation Between Large Language Model and Knowledge Graph

2024-06-25 · Tong Zhou, Yubo Chen, Kang Liu, Jun Zhao

Large language models have become integral to question-answering applications despite their propensity for generating hallucinations and factually inaccurate content. Querying knowledge graphs to reduce hallucinations in…

Knowledge Graph CompletionKnowledge GraphsLanguage ModelingLanguage Modelling+2

Mixture of Knowledge Minigraph Agents for Literature Review Generation

2024-11-09 · Zhi Zhang, Yan Liu, Sheng-hua Zhong, Gong Chen 외

Literature reviews play a crucial role in scientific research for understanding the current state of research, identifying gaps, and guiding future studies on specific topics. However, the process of conducting a compreh…

Review Generation

ScienceMeter: Tracking Scientific Knowledge Updates in Language Models

2025-05-30 · Yike Wang, Shangbin Feng, Yulia Tsvetkov, Hannaneh Hajishirzi

Large Language Models (LLMs) are increasingly used to support scientific research, but their knowledge of scientific advancements can quickly become outdated. We introduce ScienceMeter, a new framework for evaluating sci…