paper-with-me

Papers

Integration of persistent Laplacian and pre-trained transformer for protein solubility changes upon mutation

2023-10-28 · JunJie Wee, Jiahui Chen, Kelin Xia, Guo-Wei Wei

Protein mutations can significantly influence protein solubility, which results in altered protein functions and leads to various diseases. Despite of tremendous effort, machine learning prediction of protein solubility changes upon mutation remains a challenging task as indicated by the poor scores of normalized Correct Prediction Ratio (CPR). Part of the challenge stems from the fact that there is no three-dimensional (3D) structures for the wild-type and mutant proteins. This work integrates persistent Laplacians and pre-trained Transformer for the task. The Transformer, pretrained with hunderds of millions of protein sequences, embeds wild-type and mutant sequences, while persistent Laplacians track the topological invariant change and homotopic shape evolution induced by mutations in 3D protein structures, which are rendered from AlphaFold2. The resulting machine learning model was trained on an extensive data set labeled with three solubility types. Our model outperforms all existing predictive methods and improves the state-of-the-art up to 15%.

📄 PDF Abstract BibTeX arXiv:2310.18760

Code (1)

expectozjj/toplapgbt 공식 구현

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Similar Papers 제목 키워드 기반

Mathematics-assisted directed evolution and protein engineering

2023-06-06 · Yuchi Qiu, Guo-Wei Wei

Directed evolution is a molecular biology technique that is transforming protein engineering by creating proteins with desirable properties and functions. However, it is experimentally impossible to perform the deep muta…

Topological Data Analysis

PLD-Tree: Persistent Laplacian Decision Tree for Protein-Protein Binding Free Energy Prediction

2024-12-24 · Xingjian Xu, Jiahui Chen, Chunmei Wang

Recent advances in topology-based modeling have accelerated progress in physical modeling and molecular studies, including applications to protein-ligand binding affinity. In this work, we introduce the Persistent Laplac…

Language ModelingLanguage ModellingLarge Language ModelMolecular Docking

Persistent Directed Flag Laplacian (PDFL)-Based Machine Learning for Protein-Ligand Binding Affinity Prediction

2024-11-04 · Mushal Zia, Benjamin Jones, Hongsong Feng, Guo-Wei Wei

Directionality in molecular and biomolecular networks plays a significant role in the accurate represention of the complex, dynamic, and asymmetrical nature of interactions present in protein-ligand binding, signal trans…

Drug DiscoveryTopological Data Analysis

Persistent topological Laplacian analysis of SARS-CoV-2 variants

2023-01-25 · Xiaoqi Wei, Jiahui Chen, Guo-Wei Wei

Topological data analysis (TDA) is an emerging field in mathematics and data science. Its central technique, persistent homology, has had tremendous success in many science and engineering disciplines. However, persisten…

Topological Data Analysis

Persistent Sheaf Laplacian Analysis of Protein Flexibility

2025-02-12 · Nicole Hayes, Xiaoqi Wei, Hongsong Feng, Ekaterina Merkurjev 외

Protein flexibility, measured by the B-factor or Debye-Waller factor, is essential for protein functions such as structural support, enzyme activity, cellular communication, and molecular transport. Theoretical analysis …

Drug DiscoveryProtein DesignTopological Data Analysis