A Protein Structure Prediction Approach Leveraging Transformer and CNN Integration

2024-02-29 · Yanlin Zhou, Kai Tan, Xinyu Shen, Zheng He, Haotian Zheng

Proteins are essential for life, and their structure determines their function. The protein secondary structure is formed by the folding of the protein primary structure, and the protein tertiary structure is formed by the bending and folding of the secondary structure. Therefore, the study of protein secondary structure is very helpful to the overall understanding of protein structure. Although the accuracy of protein secondary structure prediction has continuously improved with the development of machine learning and deep learning, progress in the field of protein structure prediction, unfortunately, remains insufficient to meet the large demand for protein information. Therefore, based on the advantages of deep learning-based methods in feature extraction and learning ability, this paper adopts a two-dimensional fusion deep neural network model, DstruCCN, which uses Convolutional Neural Networks (CCN) and a supervised Transformer protein language model for single-sequence protein structure prediction. The training features of the two are combined to predict the protein Transformer binding site matrix, and then the three-dimensional structure is reconstructed using energy minimization.

📄 PDF Abstract BibTeX arXiv:2402.19095

Code (0)

등록된 구현이 없습니다.

Tasks

Language ModelingLanguage Modelling Prediction Protein Language Model Protein Secondary Structure Prediction Protein Structure Prediction

Methods 이 논문이 사용한 방법론

Attention 설명 없음

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Multi-Head Attention 설명 없음

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

PLAPT: Protein-Ligand Binding Affinity Prediction Using Pretrained Transformers

2024-02-08 · bioRxiv 2024 2 · Tyler Rose, Nicolo Monti, Navvye Anand, Tianyu Shen

Understanding protein-ligand binding affinity is crucial for drug discovery, enabling the identification of promising drug candidates efficiently. We introduce PLAPT, a novel model leveraging transfer learning from pre-t…

Drug Discovery Prediction Protein-Ligand Affinity Prediction Transfer Learning

Integration of persistent Laplacian and pre-trained transformer for protein solubility changes upon mutation

2023-10-28 · JunJie Wee, Jiahui Chen, Kelin Xia, Guo-Wei Wei

Protein mutations can significantly influence protein solubility, which results in altered protein functions and leads to various diseases. Despite of tremendous effort, machine learning prediction of protein solubility …

Transformers in Protein: A Survey

2025-05-26 · Xiaowen Ling, Zhiqiang Li, Yanbin Wang, Zhuhong You

As protein informatics advances rapidly, the demand for enhanced predictive accuracy, structural analysis, and functional understanding has intensified. Transformer models, as powerful deep learning architectures, have d…

Benchmarking Drug Discovery Protein Structure Prediction Survey

Geometric Self-Supervised Pretraining on 3D Protein Structures using Subgraphs

2024-06-20 · Michail Chatzianastasis, Yang Zhang, George Dasoulas, Michalis Vazirgiannis

Protein representation learning aims to learn informative protein embeddings capable of addressing crucial biological questions, such as protein function prediction. Although sequence-based transformer models have shown …

Protein Function Prediction Representation Learning

pLDDT-Predictor: High-speed Protein Screening Using Transformer and ESM2

2024-10-11 · Joongwon Chae, Zhenyu Wang, Ijaz Gul, Jiansong Ji 외

Recent advancements in protein structure prediction, particularly AlphaFold2, have revolutionized structural biology by achieving near-experimental accuracy ($\text{average RMSD} < 1.5\text{\AA}$). However, the computati…

Computational Efficiency Protein Structure Prediction