CryoProt: A Protein Pretraining Framework with Cross-Box Interactions on Cryo-EM Density Maps
Despite the growing availability of cryo-electron microscopy (cryo-EM) density maps, effectively leveraging them for protein representation remains challenging. First, current methods lack a general-purpose protein pretraining framework tailored for cryo-EM density maps, designed for protein-related property prediction. Second, existing approaches typically partition density maps into local box regions and model them independently, overlooking interactions across boxes which are essential for capturing global structural context in cryo-EM density map. To address these challenges, we propose CryoProt, a protein pretraining framework designed for cryo-EM density maps. CryoProt introduces a Map Encoder based on multi-head latent attention (MLA), where box-level representations interact through a shared latent space, enabling explicit modeling of cross-box dependencies within the density map. Furthermore, we adopt a multi-task pretraining strategy to learn generalizable representations that can be effectively transferred to diverse downstream tasks, such as protein flexibility prediction, where cryo-EM density maps are not required and can be inferred implicitly by the pretrained model. Experimental results demonstrate that CryoProt consistently outperforms existing state-of-the-art methods across multiple benchmarks, achieving up to 12% improvement over the best-performing baselines, highlighting the importance of modeling cross-box interactions in cryo-EM data. The source code is publicly available at https://anonymous.4open.science/r/CryoProt.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Attaining scalable storage-expansion dualism for bioartificial tissues
The untenable dependence of cryopreservation on cytotoxic cryoprotectants has motivated the mining of biochemical libraries to identify molecular features marking cryoprotectants that may prevent ice crystal growth. It i…
Cultural Vocal Bursts Intensity PredictionProFSA: Self-supervised Pocket Pretraining via Protein Fragment-Surroundings Alignment
Pocket representations play a vital role in various biomedical applications, such as druggability estimation, ligand affinity prediction, and de novo drug design. While existing geometric features and pretrained represen…
Drug DesignMulti-level Interaction Modeling for Protein Mutational Effect Prediction
Protein-protein interactions are central mediators in many biological processes. Accurately predicting the effects of mutations on interactions is crucial for guiding the modulation of these interactions, thereby playing…
Drug DiscoveryPredictionCCPL: Cross-modal Contrastive Protein Learning
Effective protein representation learning is crucial for predicting protein functions. Traditional methods often pretrain protein language models on large, unlabeled amino acid sequences, followed by finetuning on labele…
Language ModelingLanguage ModellingMasked Language ModelingProtein Design+2Data-Efficient Protein 3D Geometric Pretraining via Refinement of Diffused Protein Structure Decoy
Learning meaningful protein representation is important for a variety of biological downstream tasks such as structure-based drug design. Having witnessed the success of protein sequence pretraining, pretraining for stru…
DiversityDrug Design