CLASS: Enhancing Cross-Modal Text-Molecule Retrieval Performance and Training Efficiency
Cross-modal text-molecule retrieval task bridges molecule structures and natural language descriptions. Existing methods predominantly focus on aligning text modality and molecule modality, yet they overlook adaptively adjusting the learning states at different training stages and enhancing training efficiency. To tackle these challenges, this paper proposes a Curriculum Learning-bAsed croSS-modal text-molecule training framework (CLASS), which can be integrated with any backbone to yield promising performance improvement. Specifically, we quantify the sample difficulty considering both text modality and molecule modality, and design a sample scheduler to introduce training samples via an easy-to-difficult paradigm as the training advances, remarkably reducing the scale of training samples at the early stage of training and improving training efficiency. Moreover, we introduce adaptive intensity learning to increase the training intensity as the training progresses, which adaptively controls the learning intensity across all curriculum stages. Experimental results on the ChEBI-20 dataset demonstrate that our proposed method gains superior performance, simultaneously achieving prominent time savings.
Code (0)
등록된 구현이 없습니다.
Tasks
Cross-Modal RetrievalRetrievalMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Towards Cross-Modal Text-Molecule Retrieval with Better Modality Alignment
Cross-modal text-molecule retrieval model aims to learn a shared feature space of the text and molecule modalities for accurate similarity calculation, which facilitates the rapid screening of molecules with specific pro…
Contrastive Learningcross-modal alignmentCross-Modal RetrievalDrug Design+2MolX: Enhancing Large Language Models for Molecular Learning with A Multi-Modal Extension
Large Language Models (LLMs) with their strong task-handling capabilities have shown remarkable advancements across a spectrum of fields, moving beyond natural language understanding. However, their proficiency within th…
Natural Language UnderstandingRetrosynthesisAtomas: Hierarchical Alignment on Molecule-Text for Unified Molecule Understanding and Generation
Molecule-and-text cross-modal representation learning has emerged as a promising direction for enhancing the quality of molecular representation, thereby improving performance in various scientific fields. However, most …
Drug Discoverymolecular representationMolecule CaptioningRepresentation LearningAdversarial Modality Alignment Network for Cross-Modal Molecule Retrieval
The cross-modal molecule retrieval (Text2Mol) task aims to bridge the semantic gap between molecules and natural language descriptions. A solution to this non-trivial problem relies on graph convolutional network (GCN) a…
Contrastive LearningCross-Modal RetrievalRetrievalTripletUniMoT: Unified Molecule-Text Language Model with Discrete Token Representation
The remarkable success of Large Language Models (LLMs) across diverse tasks has driven the research community to extend their capabilities to molecular applications. However, most molecular LLMs employ adapter-based arch…
Language ModelingLanguage ModellingQuantization