paper-with-me

Papers

From Multi-Resolution Cells to Gigapixel Whole Slide Images Foundation Model for Computational Pathology

2026-08-04 · Basit Alawode, Moshira Ali Abdalla, Dwarikanath Mahapatra, Muhammad Muzammal Naseer, Sajid Javed arxiv

Vision Transformers (ViTs) and their hierarchical variants have achieved strong performance in Computational Pathology (CPath). However, most are pre-trained on single-resolution Whole Slide Images (WSIs), limiting their generalization across arbitrary resolutions. Gigapixel WSIs inherently contain diagnostic patterns at multiple scales, including cellular morphologies, tissue architectures, and global context, mirroring how expert pathologists examine WSIs. We introduce Multi-Resolution Pyramid Transformer (MRPT), a model that hierarchically aggregates multi-resolution information from cellular to tissue and WSI levels. MRPT employs a biologically meaningful Consecutive Cross-Resolution Attention (CCRA) mechanism to capture scale-independent interactions and enforces multi-resolution semantic consistency by aligning embeddings across resolutions, yielding robust and generalizable WSI representations. Pre-trained in a multi-resolution self-supervised manner on 624M patches, 2.4M regions, and 36K WSIs, MRPT learns rich coarse-to-fine histopathology features. Extensive experiments on 34 diverse datasets show that MRPT surpasses recent foundation models and Multimodal Large Language Models (MLLMs) in cancer subtype classification, tissue phenotyping, and Visual Question Answering (VQA) for WSI understanding.

📄 PDF Abstract BibTeX arXiv:2608.03508

Code (0)

등록된 구현이 없습니다.

Tasks

Visual Question Answering

Similar Papers 제목 키워드 기반

Scaling Vision Transformers to Gigapixel Images via Hierarchical Self-Supervised Learning

2022-06-06 · CVPR 2022 1 · Richard J. Chen, Chengkuan Chen, Yicong Li, Tiffany Y. Chen 외

Vision Transformers (ViTs) and their multi-scale and hierarchical variations have been successful at capturing image representations but their use has been generally studied for low-resolution images (e.g. - 256x256, 384…

Self-Supervised LearningSurvival Prediction

WISE: A Framework for Gigapixel Whole-Slide-Image Lossless Compression

2025-03-23 · CVPR 2025 1 · Yu Mao, Jun Wang, Nan Guan, Chun Jason Xue

Whole-Slide Images (WSIs) have revolutionized medical analysis by presenting high-resolution images of the whole tissue slide. Despite avoiding the physical storage of the slides, WSIs require considerable data volume, w…

whole slide images

Diffusion-based generation of Histopathological Whole Slide Images at a Gigapixel scale

2023-11-14 · Robert Harb, Thomas Pock, Heimo Müller

We present a novel diffusion-based approach to generate synthetic histopathological Whole Slide Images (WSIs) at an unprecedented gigapixel scale. Synthetic WSIs have many potential applications: They can augment trainin…

Image Generationwhole slide images

SlideChat: A Large Vision-Language Assistant for Whole-Slide Pathology Image Understanding

2024-10-15 · CVPR 2025 1 · Ying Chen, Guoan Wang, Yuanfeng Ji, Yanjun Li 외

Despite the progress made by multimodal large language models (MLLMs) in computational pathology, they remain limited by a predominant focus on patch-level analysis, missing essential contextual information at the whole-…

Instruction FollowingVisual Question Answering (VQA)whole slide images

A self-supervised framework for learning whole slide representations

2024-02-09 · Xinhai Hou, Cheng Jiang, Akhil Kondepudi, Yiwei Lyu 외

Whole slide imaging is fundamental to biomedical microscopy and computational pathology. Previously, learning representations for gigapixel-sized whole slide images (WSIs) has relied on multiple instance learning with we…

DiagnosticLanguage ModellingMultiple Instance LearningRepresentation Learning+2