paper-with-me

홈 › Papers

Multi-level Self-supervised Pretraining on Compositional Hierarchical Graph for Molecular Property Prediction

2026-05-15 · Xiayu Liu, Zhengyi Lu, Hou-biao Li arxiv

Self-supervised pretraining on molecular graphs has emerged as a promising approach for molecular property prediction, yet most existing methods operate at a single structural granularity and treat bond information as auxiliary edge attributes rather than as an independent semantic layer. In this work, we propose MolCHG, a multi-level self-supervised pretraining framework built upon a novel Compositional Hierarchical Graph that organizes molecular structure into four types of nodes across three semantic levels. By introducing a bond graph that operates in parallel with the atom graph, our architecture elevates bond-level information to independently evolving node representations, enabling fragment nodes to aggregate atom-level and bond-level semantics on an equal footing. We design three level-specific pretraining objectives: an atom-bond cross-view contrastive task that aligns the atom-view and bond-view representations within each fragment, a fragment-level functional group prediction task to inject domain-relevant chemical knowledge, and graph-level structure prediction tasks to encode global molecular topology. Experiments on nine MoleculeNet benchmarks demonstrate that MolCHG achieves the best performance on seven datasets across both classification and regression tasks, remaining competitive with the strongest baselines on the rest. Ablation studies further confirm that the multi-level supervision signals are complementary and that each component contributes to the overall performance.

📄 PDF Abstract BibTeX arXiv:2605.16088

Code (0)

등록된 구현이 없습니다.

Tasks

Molecular Property Prediction

Similar Papers 제목 키워드 기반

SCOT: Self-Supervised Contrastive Pretraining For Zero-Shot Compositional Retrieval

2025-01-12 · WACV 2025 3 · Bhavin Jawade, Joao V. B. Soares, Kapil Thadani, Deen Dayal Mohan 외

Compositional image retrieval (CIR) is a multimodal learning task where a model combines a query image with a user-provided text modification to retrieve a target image. CIR finds applications in a variety of domains inc…

Image RetrievalRetrievalTripletZero-Shot Composed Image Retrieval (ZS-CIR)

Does Visual Pretraining Help End-to-End Reasoning?

2023-07-17 · NeurIPS 2023 11 · Chen Sun, Calvin Luo, Xingyi Zhou, Anurag Arnab 외

We aim to investigate whether end-to-end learning of visual reasoning can be achieved with general-purpose neural networks, with the help of visual pretraining. A positive result would refute the common belief that expli…

image-classificationImage ClassificationObjectobject-detection+2

Empowering Dual-Level Graph Self-Supervised Pretraining with Motif Discovery

2023-12-19 · Pengwei Yan, Kaisong Song, Zhuoren Jiang, Yangyang Kang 외

While self-supervised graph pretraining techniques have shown promising results in various domains, their application still experiences challenges of limited topology learning, human knowledge dependency, and incompetent…

Representation LearningTransfer Learning

Nucleus-aware Self-supervised Pretraining Using Unpaired Image-to-image Translation for Histopathology Images

2023-09-14 · Zhiyun Song, Penghui Du, Junpeng Yan, Kailu Li 외

Self-supervised pretraining attempts to enhance model performance by obtaining effective features from unlabeled data, and has demonstrated its effectiveness in the field of histopathology images. Despite its success, fe…

DiversityImage-to-Image TranslationInstance SegmentationMultiple Instance Learning+2

Hierarchical Self-supervised Representation Learning for Movie Understanding

2022-04-06 · CVPR 2022 1 · Fanyi Xiao, Kaustav Kundu, Joseph Tighe, Davide Modolo

Most self-supervised video representation learning approaches focus on action recognition. In contrast, in this paper we focus on self-supervised video learning for movie understanding and propose a novel hierarchical se…

Action RecognitionContrastive LearningRepresentation Learning