paper-with-me

홈 › Papers

CLASS: Enhancing Cross-Modal Text-Molecule Retrieval Performance and Training Efficiency

2025-02-17 · Hongyan Wu, Peijian Zeng, Weixiong Zheng, Lianxi Wang, Nankai Lin, Shengyi Jiang, Aimin Yang

Cross-modal text-molecule retrieval task bridges molecule structures and natural language descriptions. Existing methods predominantly focus on aligning text modality and molecule modality, yet they overlook adaptively adjusting the learning states at different training stages and enhancing training efficiency. To tackle these challenges, this paper proposes a Curriculum Learning-bAsed croSS-modal text-molecule training framework (CLASS), which can be integrated with any backbone to yield promising performance improvement. Specifically, we quantify the sample difficulty considering both text modality and molecule modality, and design a sample scheduler to introduce training samples via an easy-to-difficult paradigm as the training advances, remarkably reducing the scale of training samples at the early stage of training and improving training efficiency. Moreover, we introduce adaptive intensity learning to increase the training intensity as the training progresses, which adaptively controls the learning intensity across all curriculum stages. Experimental results on the ChEBI-20 dataset demonstrate that our proposed method gains superior performance, simultaneously achieving prominent time savings.

📄 PDF Abstract BibTeX arXiv:2502.11633

Code (0)

등록된 구현이 없습니다.

Tasks

Cross-Modal RetrievalRetrieval

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Towards Cross-Modal Text-Molecule Retrieval with Better Modality Alignment

2024-10-31 · Jia Song, Wanru Zhuang, Yujie Lin, Liang Zhang 외

Cross-modal text-molecule retrieval model aims to learn a shared feature space of the text and molecule modalities for accurate similarity calculation, which facilitates the rapid screening of molecules with specific pro…

Contrastive Learningcross-modal alignmentCross-Modal RetrievalDrug Design+2

MolX: Enhancing Large Language Models for Molecular Learning with A Multi-Modal Extension

2024-06-10 · Khiem Le, Zhichun Guo, Kaiwen Dong, Xiaobao Huang 외

Large Language Models (LLMs) with their strong task-handling capabilities have shown remarkable advancements across a spectrum of fields, moving beyond natural language understanding. However, their proficiency within th…

Natural Language UnderstandingRetrosynthesis

Atomas: Hierarchical Alignment on Molecule-Text for Unified Molecule Understanding and Generation

2024-04-23 · Yikun Zhang, Geyan Ye, Chaohao Yuan, Bo Han 외

Molecule-and-text cross-modal representation learning has emerged as a promising direction for enhancing the quality of molecular representation, thereby improving performance in various scientific fields. However, most …

Drug Discoverymolecular representationMolecule CaptioningRepresentation Learning

Adversarial Modality Alignment Network for Cross-Modal Molecule Retrieval

2023-03-08 · IEEE Transactions on Artificial Intelligence 2023 3 · Wenyu Zhao, Dong Zhou, Buqing Cao, Kai Zhang 외

The cross-modal molecule retrieval (Text2Mol) task aims to bridge the semantic gap between molecules and natural language descriptions. A solution to this non-trivial problem relies on graph convolutional network (GCN) a…

Contrastive LearningCross-Modal RetrievalRetrievalTriplet

UniMoT: Unified Molecule-Text Language Model with Discrete Token Representation

2024-08-01 · Juzheng Zhang, Yatao Bian, Yongqiang Chen, Quanming Yao

The remarkable success of Large Language Models (LLMs) across diverse tasks has driven the research community to extend their capabilities to molecular applications. However, most molecular LLMs employ adapter-based arch…

Language ModelingLanguage ModellingQuantization