paper-with-me

Papers

Multi-omics Sampling-based Graph Transformer for Synthetic Lethality Prediction

2023-10-17 · Xusheng Zhao, Hao liu, Qiong Dai, Hao Peng, Xu Bai, Huailiang Peng

Synthetic lethality (SL) prediction is used to identify if the co-mutation of two genes results in cell death. The prevalent strategy is to abstract SL prediction as an edge classification task on gene nodes within SL data and achieve it through graph neural networks (GNNs). However, GNNs suffer from limitations in their message passing mechanisms, including over-smoothing and over-squashing issues. Moreover, harnessing the information of non-SL gene relationships within large-scale multi-omics data to facilitate SL prediction poses a non-trivial challenge. To tackle these issues, we propose a new multi-omics sampling-based graph transformer for SL prediction (MSGT-SL). Concretely, we introduce a shallow multi-view GNN to acquire local structural patterns from both SL and multi-omics data. Further, we input gene features that encode multi-view information into the standard self-attention to capture long-range dependencies. Notably, starting with batch genes from SL data, we adopt parallel random walk sampling across multiple omics gene graphs encompassing them. Such sampling effectively and modestly incorporates genes from omics in a structure-aware manner before using self-attention. We showcase the effectiveness of MSGT-SL on real-world SL tasks, demonstrating the empirical benefits gained from the graph transformer and multi-omics data.

📄 PDF Abstract BibTeX arXiv:2310.11082

Code (0)

등록된 구현이 없습니다.

Tasks

Edge ClassificationPrediction

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Residual Connection 설명 없음
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

Graph Neural Networks as a Substitute for Transformers in Single-Cell Transcriptomics

2025-07-05 · Jiaxin Qi, Yan Cui, Jinli Ou, Jianqiang Huang 외 arxiv

Graph Neural Networks (GNNs) and Transformers share significant similarities in their encoding strategies for interacting with features from nodes of interest, where Transformers use query-key scores and GNNs use edges. …

Multi-Omics Analysis for Cancer Subtype Inference via Unrolling Graph Smoothness Priors

2025-08-08 · Jielong Lu, Zhihao Wu, Jiajun Yu, Jiajun Bu 외 arxiv

Integrating multi-omics datasets through data-driven analysis offers a comprehensive understanding of the complex biological processes underlying various diseases, particularly cancer. Graph Neural Networks (GNNs) have r…

Contrastive Learning

DeepDTF: Dual-Branch Transformer Fusion for Multi-Omics Anticancer Drug Response Prediction

2026-03-25 · Yuhan Zhao, Jacob Tennant, James Yang, Zhishan Guo 외 arxiv

Cancer drug response varies widely across tumors due to multi-layer molecular heterogeneity, motivating computational decision support for precision oncology. Despite recent progress in deep CDR models, robust alignment …

Sensitivity ClassificationDrug Response Prediction

Hierarchical Graph Transformer with Adaptive Node Sampling

2022-10-08 · Zaixi Zhang, Qi Liu, Qingyong Hu, Chee-Kong Lee

The Transformer architecture has achieved remarkable success in a number of domains including natural language processing and computer vision. However, when it comes to graph-structured data, transformers have not achiev…

Towards a Better Model with Dual Transformer for Drug Response Prediction

2022-10-23 · Kun Li, Jia Wu, Bo Du, Sergey V. Petoukhov 외

GNN-based methods have achieved excellent results as a mainstream task in drug response prediction tasks in recent years. Traditional GNN methods use only the atoms in a drug molecule as nodes to obtain the representatio…

Drug Response Prediction