paper-with-me

Papers

KITE-DDI: A Knowledge graph Integrated Transformer Model for accurately predicting Drug-Drug Interaction Events from Drug SMILES and Biomedical Knowledge Graph

2024-12-08 · Azwad Tamir, Jiann-Shiun Yuan

It is a common practice in modern medicine to prescribe multiple medications simultaneously to treat diseases. However, these medications could have adverse reactions between them, known as Drug-Drug Interactions (DDI), which have the potential to cause significant bodily injury and could even be fatal. Hence, it is essential to identify all the DDI events before prescribing multiple drugs to a patient. Most contemporary research for predicting DDI events relies on either information from Biomedical Knowledge graphs (KG) or drug SMILES, with very few managing to merge data from both to make predictions. While others use heuristic algorithms to extract features from SMILES and KGs, which are then fed into a Deep Learning framework to generate output. In this study, we propose a KG-integrated Transformer architecture to generate an end-to-end fully automated Machine Learning pipeline for predicting DDI events with high accuracy. The algorithm takes full-scale molecular SMILES sequences of a pair of drugs and a biomedical KG as input and predicts the interaction between the two drugs with high precision. The results show superior performance in two different benchmark datasets compared to existing state-of-the-art models especially when the test and training sets contain distinct sets of drug molecules. This demonstrates the strong generalization of the proposed model, indicating its potential for DDI event prediction for newly developed drugs. The model does not depend on heuristic models for generating embeddings and has a minimal number of hyperparameters, making it easy to use while demonstrating outstanding performance in low-data scenarios.

📄 PDF Abstract BibTeX arXiv:2412.05770

Code (0)

등록된 구현이 없습니다.

Tasks

Knowledge Graphs

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Adam 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Position-Wise Feed-Forward Layer 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Similar Papers 제목 키워드 기반

KITE: A Tri-Modal Transformer Integrating Text, Images, and Knowledge Graphs for Fake News Detection

2026-06-02 · Kevin Patel, Shashi Bhushan Jha arxiv

Traditional fake news detection methods are falling behind as multimodal misinformation grows more advanced, seamlessly blending deceptive text, manipulated visuals, and factually incorrect claims. Most prior work focuse…

Fake News DetectionKnowledge Graphs

Perovskite-LLM: Knowledge-Enhanced Large Language Models for Perovskite Solar Cell Research

2025-02-18 · Xiang Liu, Penglei Sun, Shuyan Chen, Longhan Zhang 외

The rapid advancement of perovskite solar cells (PSCs) has led to an exponential growth in research publications, creating an urgent need for efficient knowledge management and reasoning systems in this domain. We presen…

Experimental Design

LEAP: A closed-loop framework for perovskite precursor additive discovery

2026-05-18 · Xin-De Wang, Zhi-Rui Chen, Ze-Feng Gao, Peng-Jie Guo 외 arxiv

Efficient discovery of precursor additives is essential for improving the performance of perovskite solar cells, yet the large chemical space makes conventional trial-and-error screening inefficient. We develop LEAP(LLM-…

Active Learning

WikiGraphs: A Wikipedia Text - Knowledge Graph Paired Dataset

2021-07-20 · NAACL (TextGraphs) 2021 6 · Luyu Wang, Yujia Li, Ozlem Aslan, Oriol Vinyals

We present a new dataset of Wikipedia articles each paired with a knowledge graph, to facilitate the research in conditional text generation, graph generation and graph representation learning. Existing graph-text paired…

ArticlesConditional Text GenerationGraph GenerationGraph Neural Network+6

Barack's Wife Hillary: Using Knowledge-Graphs for Fact-Aware Language Modeling

2019-06-17 · Robert L. Logan IV, Nelson F. Liu, Matthew E. Peters, Matt Gardner 외

Modeling human language requires the ability to not only generate fluent text but also encode factual knowledge. However, traditional language models are only capable of remembering facts seen at training time, and often…

Knowledge GraphsLanguage ModelingLanguage Modelling