paper-with-me

Papers

MultiST: A Cross-Attention-Based Multimodal Model for Spatial Transcriptomic

2026-01-19 · Wei Wang, Quoc-Toan Ly, Chong Yu, Jun Bai arxiv

Spatial transcriptomics (ST) enables transcriptome-wide profiling while preserving the spatial context of tissues, offering unprecedented opportunities to study tissue organization and cell-cell interactions in situ. Despite recent advances, existing methods often lack effective integration of histological morphology with molecular profiles, relying on shallow fusion strategies or omitting tissue images altogether, which limits their ability to resolve ambiguous spatial domain boundaries. To address this challenge, we propose MultiST, a unified multimodal framework that jointly models spatial topology, gene expression, and tissue morphology through cross-attention-based fusion. MultiST employs graph-based gene encoders with adversarial alignment to learn robust spatial representations, while integrating color-normalized histological features to capture molecular-morphological dependencies and refine domain boundaries. We evaluated the proposed method on 13 diverse ST datasets spanning two organs, including human brain cortex and breast cancer tissue. MultiST yields spatial domains with clearer and more coherent boundaries than existing methods, leading to more stable pseudotime trajectories and more biologically interpretable cell-cell interaction patterns. The MultiST framework and source code are available at https://github.com/LabJunBMI/MultiST.git.

📄 PDF Abstract BibTeX arXiv:2601.13331

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

SENCA-st: Integrating Spatial Transcriptomics and Histopathology with Cross Attention Shared Encoder for Region Identification in Cancer Pathology

2025-11-11 · Shanaka Liyanaarachchi, Chathurya Wijethunga, Shihab Aaqil Ahamed, Akthas Absar 외 arxiv

Spatial transcriptomics is an emerging field that enables the identification of functional regions based on the spatial distribution of gene expression. Integrating this functional information present in transcriptomic d…

Contrastive Learning

ST-Align: A Multimodal Foundation Model for Image-Gene Alignment in Spatial Transcriptomics

2024-11-25 · Yuxiang Lin, Ling Luo, Ying Chen, Xushi Zhang 외

Spatial transcriptomics (ST) provides high-resolution pathological images and whole-transcriptomic expression profiles at individual spots across whole-slide scales. This setting makes it an ideal data source to develop …

LATTICE: Graph Self-Supervised Learning for Multimodal Spatial Omics Integration

2026-07-15 · Jagan Mohan Reddy Dwarampudi, Veena Kochat, Suresh Satpati, Kunal Rai 외 arxiv

Spatially resolved omics studies increasingly combine transcriptomic and epigenomic assays, yet downstream analysis is often still performed using single-modality pipelines. We present LATTICE (Latent Alignment of Tissue…

Self-Supervised Learning

Fusing Pixels and Genes: Spatially-Aware Learning in Computational Pathology

2026-02-15 · Minghao Han, Dingkang Yang, Linhao Qu, Zizhi Chen 외 arxiv

Recent years have witnessed remarkable progress in multimodal learning within computational pathology. Existing models primarily rely on vision and language modalities; however, language alone lacks molecular specificity…

Representation Learning

A Large-Scale Benchmark of Cross-Modal Learning for Histology and Gene Expression in Spatial Transcriptomics

2025-08-02 · Rushin H. Gindra, Giovanni Palla, Mathias Nguyen, Sophia J. Wagner 외 arxiv

Spatial transcriptomics enables simultaneous measurement of gene expression and tissue morphology, offering unprecedented insights into cellular organization and disease mechanisms. However, the field lacks comprehensive…