Integrating protein sequence embeddings with structure via graph-based deep learning for the prediction of single-residue properties
Understanding the intertwined contributions of amino acid sequence and spatial structure is essential to explain protein behaviour. Here, we introduce INFUSSE (Integrated Network Framework Unifying Structure and Sequence Embeddings), a Deep Learning framework that combines sequence embeddings, generated by a Large Language Model (LLM), with graph-based representations of protein structures, integrated through a diffusive Graph Convolutional Network (diff-GCN), to predict single-residue properties within proteins. Our approach follows two steps. First, we fine-tune LLM sequence embeddings obtained from bidirectional transformers to make predictions from protein sequence alone. Second, we combine these enriched sequence representations with a geometric graph Laplacian within diff-GCN to refine the initial predictions. This approach leads to improved predictions while allowing us to systematically disentangle the contribution of sequence and structure. We illustrate our framework by applying it to the prediction of local residue flexibility (B-factors) of antibody-antigen complexes, and show that it provides improved performance compared to current Machine Learning (ML) approaches. The addition of structural information via geometric graphs is shown to enhance predictions especially for intrinsically disordered regions, protein-protein interaction sites, and highly variable amino acid positions.
Code (0)
등록된 구현이 없습니다.
Tasks
Large Language ModelSimilar Papers 제목 키워드 기반
DrugTar Improves Druggability Prediction by Integrating Large Language Models and Gene Ontologies
Target discovery is crucial in drug development, especially for complex chronic diseases. Recent advances in high-throughput technologies and the explosion of biomedical data have highlighted the potential of computation…
Language ModelingLanguage ModellingProtein Language ModelProtein Language Model-Powered 3D Ligand Binding Site Prediction from Protein Sequence
Prediction of ligand binding sites of proteins is a fundamental and important task for understanding the function of proteins and screening potential drugs. Most existing methods require experimentally determined protein…
Drug DiscoveryGraph Neural NetworkLanguage ModelingLanguage Modelling+1GraphSeqLM: A Unified Graph Language Framework for Omic Graph Learning
The integration of multi-omic data is pivotal for understanding complex diseases, but its high dimensionality and noise present significant challenges. Graph Neural Networks (GNNs) offer a robust framework for analyzing …
Data IntegrationGraph LearningLanguage ModelingLanguage ModellingSTAR-GO: Improving Protein Function Prediction by Learning to Hierarchically Integrate Ontology-Informed Semantic Embeddings
Accurate prediction of protein function is essential for elucidating molecular mechanisms and advancing biological and therapeutic discovery. Yet experimental annotation lags far behind the rapid growth of protein sequen…
Protein Function PredictionZero-shot GeneralizationA Multimodal Human Protein Embeddings Database: DeepDrug Protein Embeddings Bank (DPEB)
Computationally predicting protein-protein interactions (PPIs) is challenging due to the lack of integrated, multimodal protein representations. DPEB is a curated collection of 22,043 human proteins that integrates four …
Graph Neural Network