Spatial Transcriptomics Analysis of Zero-shot Gene Expression Prediction
Spatial transcriptomics (ST) captures gene expression within distinct regions (i.e., windows) of a tissue slide. Traditional supervised learning frameworks applied to model ST are constrained to predicting expression from slide image windows for gene types seen during training, failing to generalize to unseen gene types. To overcome this limitation, we propose a semantic guided network (SGN), a pioneering zero-shot framework for predicting gene expression from slide image windows. Considering a gene type can be described by functionality and phenotype, we dynamically embed a gene type to a vector per its functionality and phenotype, and employ this vector to project slide image windows to gene expression in feature space, unleashing zero-shot expression prediction for unseen gene types. The gene type functionality and phenotype are queried with a carefully designed prompt from a pre-trained large language model (LLM). On standard benchmark datasets, we demonstrate competitive zero-shot performance compared to past state-of-the-art supervised learning approaches.
Code (0)
등록된 구현이 없습니다.
Tasks
Language ModelingLanguage ModellingLarge Language ModelPredictionSimilar Papers 제목 키워드 기반
Learning from Gene Names, Expression Values and Images: Contrastive Masked Text-Image Pretraining for Spatial Transcriptomics Representation Learning
Spatial transcriptomics aims to connect high-resolution histology images with spatially resolved gene expression. To achieve better performance on downstream tasks such as gene expression prediction, large-scale pre-trai…
Representation LearningMOSAIK: Multi-Origin Spatial Transcriptomics Analysis and Integration Kit
Spatial transcriptomics (ST) has revolutionised transcriptomics analysis by preserving tissue architecture, allowing researchers to study gene expression in its native spatial context. However, despite its potential, ST …
PersiST: Robust Identification of Spatially Variable Features in Spatial Omics Datasets via Topological Data Analysis
Spatial transcriptomics studies are becoming increasingly large and commonplace, necessitating the analysis of a large number of spatially resolved variables. With spatial transcriptomics data sets typically containing d…
Topological Data AnalysisCross-Modal Knowledge Distillation from Spatial Transcriptomics to Histology
Spatial transcriptomics provides a molecularly rich description of tissue organization, enabling unsupervised discovery of tissue niches -- spatially coherent regions of distinct cell-type composition and function that a…
Knowledge DistillationST-Align: A Multimodal Foundation Model for Image-Gene Alignment in Spatial Transcriptomics
Spatial transcriptomics (ST) provides high-resolution pathological images and whole-transcriptomic expression profiles at individual spots across whole-slide scales. This setting makes it an ideal data source to develop …