paper-with-me

Papers

Protein Representation Learning by Capturing Protein Sequence-Structure-Function Relationship

2024-04-29 · Eunji Ko, Seul Lee, Minseon Kim, DongKi Kim

The goal of protein representation learning is to extract knowledge from protein databases that can be applied to various protein-related downstream tasks. Although protein sequence, structure, and function are the three key modalities for a comprehensive understanding of proteins, existing methods for protein representation learning have utilized only one or two of these modalities due to the difficulty of capturing the asymmetric interrelationships between them. To account for this asymmetry, we introduce our novel asymmetric multi-modal masked autoencoder (AMMA). AMMA adopts (1) a unified multi-modal encoder to integrate all three modalities into a unified representation space and (2) asymmetric decoders to ensure that sequence latent features reflect structural and functional information. The experiments demonstrate that the proposed AMMA is highly effective in learning protein representations that exhibit well-aligned inter-modal relationships, which in turn makes it effective for various downstream protein-related tasks.

📄 PDF Abstract BibTeX arXiv:2405.06663

Code (0)

등록된 구현이 없습니다.

Tasks

Representation Learning

Similar Papers 제목 키워드 기반

Leveraging Multi-modal Representations to Predict Protein Melting Temperatures

2024-12-05 · Daiheng Zhang, Yan Zeng, Xinyu Hong, Jinbo Xu

Accurately predicting protein melting temperature changes (Delta Tm) is fundamental for assessing protein stability and guiding protein engineering. Leveraging multi-modal protein representations has shown great promise …

Prediction

Deep Multi-attribute Graph Representation Learning on Protein Structures

2020-12-22 · Tian Xia, Wei-Shinn Ku

Graphs as a type of data structure have recently attracted significant attention. Representation learning of geometric graphs has achieved great success in many fields including molecular, social, and financial networks.…

AttributeGraph Neural NetworkGraph Representation LearningRepresentation Learning

Protein Secondary Structure Prediction Using Transformers

2025-12-09 · Manzi Kevin Maxime arxiv

Predicting protein secondary structures such as alpha helices, beta sheets, and coils from amino acid sequences is essential for understanding protein function. This work presents a transformer-based model that applies a…

Protein Secondary Structure PredictionData Augmentation

ProtVec: A Continuous Distributed Representation of Biological Sequences

2015-03-17 · Ehsaneddin Asgari, Mohammad R. K. Mofrad

We introduce a new representation and feature extraction method for biological sequences. Named bio-vectors (BioVec) to refer to biological sequences in general with protein-vectors (ProtVec) for proteins (amino-acid seq…

ClassificationGeneral Classification

ProtST: Multi-Modality Learning of Protein Sequences and Biomedical Texts

2023-01-28 · Minghao Xu, Xinyu Yuan, Santiago Miret, Jian Tang

Current protein language models (PLMs) learn protein representations mainly based on their sequences, thereby well capturing co-evolutionary information, but they are unable to explicitly acquire protein functions, which…

Representation LearningRetrieval