paper-with-me

홈 › Papers

Towards Incorporating Entity-specific Knowledge Graph Information in Predicting Drug-Drug Interactions

2020-12-21 · Ishani Mondal

Off-the-shelf biomedical embeddings obtained from the recently released various pre-trained language models (such as BERT, XLNET) have demonstrated state-of-the-art results (in terms of accuracy) for the various natural language understanding tasks (NLU) in the biomedical domain. Relation Classification (RC) falls into one of the most critical tasks. In this paper, we explore how to incorporate domain knowledge of the biomedical entities (such as drug, disease, genes), obtained from Knowledge Graph (KG) Embeddings, for predicting Drug-Drug Interaction from textual corpus. We propose a new method, BERTKG-DDI, to combine drug embeddings obtained from its interaction with other biomedical entities along with domain-specific BioBERT embedding-based RC architecture. Experiments conducted on the DDIExtraction 2013 corpus clearly indicate that this strategy improves other baselines architectures by 4.1% macro F1-score.

📄 PDF Abstract BibTeX arXiv:2012.11142

Code (0)

등록된 구현이 없습니다.

Tasks

Natural Language UnderstandingRelation Classification

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Adam 설명 없음
Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Weight Decay 설명 없음

Similar Papers 제목 키워드 기반

TIGER: Temporally Improved Graph Entity Linker

2024-10-11 · Pengyu Zhang, Congfeng Cao, Paul Groth

Knowledge graphs change over time, for example, when new entities are introduced or entity descriptions change. This impacts the performance of entity linking, a key task in many uses of knowledge graphs such as web sear…

Entity LinkingKnowledge Graphs

Knowledge Graph Embedding with Entity Neighbors and Deep Memory Network

2018-08-11 · Kai Wang, Yu Liu, Xiujuan Xu, Dan Lin

Knowledge Graph Embedding (KGE) aims to represent entities and relations of knowledge graph in a low-dimensional continuous vector space. Recent works focus on incorporating structural knowledge with additional informati…

Graph EmbeddingKnowledge Graph Embedding

Jointly Learning Knowledge Embedding and Neighborhood Consensus with Relational Knowledge Distillation for Entity Alignment

2022-01-25 · Xinhang Li, Yong Zhang, Chunxiao Xing

Entity alignment aims at integrating heterogeneous knowledge from different knowledge graphs. Recent studies employ embedding-based methods by first learning the representation of Knowledge Graphs and then performing ent…

BenchmarkingEntity AlignmentEntity EmbeddingsKnowledge Distillation+2

Research on Joint Representation Learning Methods for Entity Neighborhood Information and Description Information

2023-09-15 · Le Xiao, Xin Shan, Yuhua Wang, Miaolei Deng

To address the issue of poor embedding performance in the knowledge graph of a programming design course, a joint represen-tation learning model that combines entity neighborhood infor-mation and description information …

Representation Learning

MMGraphRAG: Bridging Vision and Language with Interpretable Multimodal Knowledge Graphs

2025-07-28 · Xueyao Wan, Hang Yu arxiv

Large Language Models (LLMs) often suffer from hallucinations, which Retrieval-Augmented Generation (RAG) and GraphRAG mitigate by incorporating external knowledge and knowledge graphs (KGs). However, GraphRAG remains te…

Knowledge GraphsEntity AlignmentEntity Linking