paper-with-me

홈 › Papers

PATHS: A Hierarchical Transformer for Efficient Whole Slide Image Analysis

2024-11-27 · Zak Buzzard, Konstantin Hemker, Nikola Simidjievski, Mateja Jamnik

Computational analysis of whole slide images (WSIs) has seen significant research progress in recent years, with applications ranging across important diagnostic and prognostic tasks such as survival or cancer subtype prediction. Many state-of-the-art models process the entire slide - which may be as large as $150,000 \times 150,000$ pixels - as a bag of many patches, the size of which necessitates computationally cheap feature aggregation methods. However, a large proportion of these patches are uninformative, such as those containing only healthy or adipose tissue, adding significant noise and size to the bag. We propose Pathology Transformer with Hierarchical Selection (PATHS), a novel top-down method for hierarchical weakly supervised representation learning on slide-level tasks in computational pathology. PATHS is inspired by the cross-magnification manner in which a human pathologist examines a slide, recursively filtering patches at each magnification level to a small subset relevant to the diagnosis. Our method overcomes the complications of processing the entire slide, enabling quadratic self-attention and providing a simple interpretable measure of region importance. We apply PATHS to five datasets of The Cancer Genome Atlas (TCGA), and achieve superior performance on slide-level prediction tasks when compared to previous methods, despite processing only a small proportion of the slide.

📄 PDF Abstract BibTeX arXiv:2411.18225

Code (1)

zzbuzzard/paths 공식 구현 pytorch

Tasks

DiagnosticRepresentation Learningwhole slide images

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Adam 설명 없음

Similar Papers 제목 키워드 기반

Hierarchical Vision Transformers for Context-Aware Prostate Cancer Grading in Whole Slide Images

2023-12-19 · Clément Grisi, Geert Litjens, Jeroen van der Laak

Vision Transformers (ViTs) have ushered in a new era in computer vision, showcasing unparalleled performance in many challenging tasks. However, their practical deployment in computational pathology has largely been cons…

whole slide images

ConSlide: Asynchronous Hierarchical Interaction Transformer with Breakup-Reorganize Rehearsal for Continual Whole Slide Image Analysis

2023-08-25 · ICCV 2023 1 · Yanyan Huang, Weiqin Zhao, Shujun Wang, Yu Fu 외

Whole slide image (WSI) analysis has become increasingly important in the medical imaging community, enabling automated and objective diagnosis, prognosis, and therapeutic-response prediction. However, in clinical practi…

Continual LearningPrognosis

HIGT: Hierarchical Interaction Graph-Transformer for Whole Slide Image Analysis

2023-09-14 · Ziyu Guo, Weiqin Zhao, Shujun Wang, Lequan Yu

In computation pathology, the pyramid structure of gigapixel Whole Slide Images (WSIs) has recently been studied for capturing various information from individual cell interactions to tissue microenvironments. This hiera…

Graph Neural NetworkPrognosiswhole slide images

Scaling Vision Transformers to Gigapixel Images via Hierarchical Self-Supervised Learning

2022-06-06 · CVPR 2022 1 · Richard J. Chen, Chengkuan Chen, Yicong Li, Tiffany Y. Chen 외

Vision Transformers (ViTs) and their multi-scale and hierarchical variations have been successful at capturing image representations but their use has been generally studied for low-resolution images (e.g. - 256x256, 384…

Self-Supervised LearningSurvival Prediction

Diagnose Like a Pathologist: Transformer-Enabled Hierarchical Attention-Guided Multiple Instance Learning for Whole Slide Image Classification

2023-01-19 · Conghao Xiong, Hao Chen, Joseph J. Y. Sung, Irwin King

Multiple Instance Learning (MIL) and transformers are increasingly popular in histopathology Whole Slide Image (WSI) classification. However, unlike human pathologists who selectively observe specific regions of histopat…

image-classificationImage ClassificationMultiple Instance Learning