Investigating Knowledge Distillation Through Neural Networks for Protein Binding Affinity Prediction
The trade-off between predictive accuracy and data availability makes it difficult to predict protein--protein binding affinity accurately. The lack of experimentally resolved protein structures limits the performance of structure-based machine learning models, which generally outperform sequence-based methods. In order to overcome this constraint, we suggest a regression framework based on knowledge distillation that uses protein structural data during training and only needs sequence data during inference. The suggested method uses binding affinity labels and intermediate feature representations to jointly supervise the training of a sequence-based student network under the guidance of a structure-informed teacher network. Leave-One-Complex-Out (LOCO) cross-validation was used to assess the framework on a non-redundant protein--protein binding affinity benchmark dataset. A maximum Pearson correlation coefficient (P_r) of 0.375 and an RMSE of 2.712 kcal/mol were obtained by sequence-only baseline models, whereas a P_r of 0.512 and an RMSE of 2.445 kcal/mol were obtained by structure-based models. With a P_r of 0.481 and an RMSE of 2.488 kcal/mol, the distillation-based student model greatly enhanced sequence-only performance. Improved agreement and decreased bias were further confirmed by thorough error analyses. With the potential to close the performance gap between sequence-based and structure-based models as larger datasets become available, these findings show that knowledge distillation is an efficient method for transferring structural knowledge to sequence-based predictors. The source code for running inference with the proposed distillation-based binding affinity predictor can be accessed at https://github.com/wajidarshad/ProteinAffinityKD.
Code (0)
등록된 구현이 없습니다.
Tasks
Knowledge DistillationSimilar Papers 제목 키워드 기반
Predicting ATP binding sites in protein sequences using Deep Learning and Natural Language Processing
Predicting ATP-Protein Binding sites in genes is of great significance in the field of Biology and Medicine. The majority of research in this field has been conducted through time- and resource-intensive 'wet experiments…
Deep LearningWord EmbeddingsDeeperBind: Enhancing Prediction of Sequence Specificities of DNA Binding Proteins
Transcription factors (TFs) are macromolecules that bind to \textit{cis}-regulatory specific sub-regions of DNA promoters and initiate transcription. Finding the exact location of these binding sites (aka motifs) is impo…
Drug DesignSpecificityOtter-Knowledge: benchmarks of multimodal knowledge graph representation learning from different sources for drug discovery
Recent research on predicting the binding affinity between drug molecules and proteins use representations learned, through unsupervised learning techniques, from large databases of molecule SMILES and protein sequences.…
Drug DiscoveryGraph Representation LearningKnowledge GraphsPrediction+1MultiRBP: Multi-task Neural Network for Protein–RNA Binding Prediction
Protein–RNA binding plays vital roles in post-transcriptional gene regulation. High-throughput in vitro binding measurements were generated for more than 200 RNA-binding proteins, enabling the development of computationa…
Structure-Based Function Prediction of Functionally Unannotated Structures in the PDB: Prediction of ATP, GTP, Sialic Acid, Retinoic Acid and Heme-bound and -Unbound (Free) Nitric Oxide Protein Binding Sites
Due to increased activity in high-throughput structural genomics efforts around the globe, there has been an accumulation of experimental protein 3D structures lacking functional annotation, thus creating a need for stru…
Specificity