paper-with-me

홈 › Papers

Towards Spatial Transcriptomics-guided Pathological Image Recognition with Batch-Agnostic Encoder

2025-03-10 · Kazuya Nishimura, Ryoma Bise, Yasuhiro Kojima

Spatial transcriptomics (ST) is a novel technique that simultaneously captures pathological images and gene expression profiling with spatial coordinates. Since ST is closely related to pathological features such as disease subtypes, it may be valuable to augment image representation with pathological information. However, there are no attempts to leverage ST for image recognition ({\it i.e,} patch-level classification of subtypes of pathological image.). One of the big challenges is significant batch effects in spatial transcriptomics that make it difficult to extract pathological features of images from ST. In this paper, we propose a batch-agnostic contrastive learning framework that can extract consistent signals from gene expression of ST in multiple patients. To extract consistent signals from ST, we utilize the batch-agnostic gene encoder that is trained in a variational inference manner. Experiments demonstrated the effectiveness of our framework on a publicly available dataset. Code is publicly available at https://github.com/naivete5656/TPIRBAE

📄 PDF Abstract BibTeX arXiv:2503.07173

Code (1)

naivete5656/tpirbae 공식 구현 pytorch

Tasks

Contrastive LearningVariational Inference

Methods 이 논문이 사용한 방법론

Variational Inference 설명 없음
Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

BiTro: Bidirectional Transfer Learning Enhances Bulk and Spatial Transcriptomics Prediction in Cancer Pathological Images

2026-03-16 · Jingkun Yu, Guangkai Shang, Changtao Li, Xun Gong 외 arxiv

Cancer pathological analysis requires modeling tumor heterogeneity across multiple modalities, primarily through transcriptomics and whole slide imaging (WSI), along with their spatial relations. On one hand, bulk transc…

Multiple Instance LearningTransfer Learning

GeneFlow: Translation of Single-cell Gene Expression to Histopathological Images via Rectified Flow

2025-10-31 · Mengbo Wang, Shourya Verma, Aditya Malusare, Luopin Wang 외 arxiv

Spatial transcriptomics (ST) technologies can be used to align transcriptomes with histopathological morphology, presenting exciting new opportunities for biomolecular discovery. Using ST data, we construct a novel frame…

Fusing Pixels and Genes: Spatially-Aware Learning in Computational Pathology

2026-02-15 · Minghao Han, Dingkang Yang, Linhao Qu, Zizhi Chen 외 arxiv

Recent years have witnessed remarkable progress in multimodal learning within computational pathology. Existing models primarily rely on vision and language modalities; however, language alone lacks molecular specificity…

Representation Learning

GC-MoE: Genomics-Guided Cell-Type-Specific Mixture of Experts for Histology-Based Single-Cell Spatial Transcriptomics

2026-06-01 · Kaito Shiku, Ahtisham Fazeel Abbasi, Ryoma Bise, Yuichiro Iwashita 외 arxiv

Histology-based single-cell spatial transcriptomics (ST) estimation aims to predict gene expression for individual cells from histopathological images and cell locations, reducing the need for costly single-cell ST measu…

Leveraging Spatial Transcriptomics as Alternative to Manual Annotations for Deep Learning-Based Nuclei Analysis

2026-04-26 · Kazuya Nishimura, Ryoma Bise, Haruka Hirose, Yasuhiro Kojima arxiv

Deep learning-based nuclei segmentation and classification in pathology images typically rely on large-scale pixel-level manual annotations, which are costly and difficult to obtain across diverse tissues and staining co…