paper-with-me

홈 › Papers

Learning Cell-Aware Hierarchical Multi-Modal Representations for Robust Molecular Modeling

2025-11-26 · Mengran Li, Zelin Zang, Wenbin Xing, Junzhou Chen, Ronghui Zhang, Jiebo Luo, Stan Z. Li arxiv

Understanding how chemical perturbations propagate through biological systems is essential for robust molecular property prediction. While most existing methods focus on chemical structures alone, recent advances highlight the crucial role of cellular responses such as morphology and gene expression in shaping drug effects. However, current cell-aware approaches face two key limitations: (1) modality incompleteness in external biological data, and (2) insufficient modeling of hierarchical dependencies across molecular, cellular, and genomic levels. We propose CHMR (Cell-aware Hierarchical Multi-modal Representations), a robust framework that jointly models local-global dependencies between molecules and cellular responses and captures latent biological hierarchies via a novel tree-structured vector quantization module. Evaluated on nine public benchmarks spanning 728 tasks, CHMR outperforms state-of-the-art baselines, yielding average improvements of 3.6% on classification and 17.2% on regression tasks. These results demonstrate the advantage of hierarchy-aware, multimodal learning for reliable and biologically grounded molecular representations, offering a generalizable framework for integrative biomedical modeling. The code is in https://github.com/limengran98/CHMR.

📄 PDF Abstract BibTeX arXiv:2511.21120

Code (0)

등록된 구현이 없습니다.

Tasks

Molecular Property Prediction

Similar Papers 제목 키워드 기반

SIGMMA: Hierarchical Graph-Based Multi-Scale Multi-modal Contrastive Alignment of Histopathology Image and Spatial Transcriptome

2025-11-19 · Dabin Jeong, Amirhossein Vahidi, Ciro Ramírez-Suástegui, Marie Moullet 외 arxiv

Recent advances in computational pathology have leveraged vision-language models to learn joint representations of Hematoxylin and Eosin (HE) images with spatial transcriptomic (ST) profiles. However, existing approaches…

Cross-Modal Retrieval

HEIST: A Graph Foundation Model for Spatial Transcriptomics and Proteomics Data

2025-06-11 · Hiren Madhu, João Felipe Rocha, Tinglin Huang, Siddharth Viswanath 외

Single-cell transcriptomics has become a great source for data-driven insights into biology, enabling the use of advanced deep learning methods to understand cellular heterogeneity and transcriptional regulation at the s…

Contrastive LearningImputation

Hierarchical Contrastive Learning for Multimodal Data

2026-04-07 · Huichao Li, Junhan Yu, Doudou Zhou arxiv

Multimodal representation learning is commonly built on a shared-private decomposition, treating latent information as either common to all modalities or specific to one. This binary view is often inadequate: many factor…

Representation LearningContrastive Learning

LAMPRET: Layout-Aware Multimodal PreTraining for Document Understanding

2021-04-16 · Te-Lin Wu, Cheng Li, Mingyang Zhang, Tao Chen 외

Document layout comprises both structural and visual (eg. font-sizes) information that is vital but often ignored by machine learning models. The few existing models which do use layout information only consider textual …

document understanding

Orthogonal Hierarchical Decomposition for Structure-Aware Table Understanding with Large Language Models

2026-02-02 · Bin Cao, Huixian Lu, Chenwen Ma, Ting Wang 외 arxiv

Complex tables with multi-level headers, merged cells and heterogeneous layouts pose persistent challenges for LLMs in both understanding and reasoning. Existing approaches typically rely on table linearization or normal…

Question Answering