paper-with-me

Papers

Integrative Graph-Transformer Framework for Histopathology Whole Slide Image Representation and Classification

2024-03-26 · Zhan Shi, Jingwei Zhang, Jun Kong, Fusheng Wang

In digital pathology, the multiple instance learning (MIL) strategy is widely used in the weakly supervised histopathology whole slide image (WSI) classification task where giga-pixel WSIs are only labeled at the slide level. However, existing attention-based MIL approaches often overlook contextual information and intrinsic spatial relationships between neighboring tissue tiles, while graph-based MIL frameworks have limited power to recognize the long-range dependencies. In this paper, we introduce the integrative graph-transformer framework that simultaneously captures the context-aware relational features and global WSI representations through a novel Graph Transformer Integration (GTI) block. Specifically, each GTI block consists of a Graph Convolutional Network (GCN) layer modeling neighboring relations at the local instance level and an efficient global attention model capturing comprehensive global information from extensive feature embeddings. Extensive experiments on three publicly available WSI datasets: TCGA-NSCLC, TCGA-RCC and BRIGHT, demonstrate the superiority of our approach over current state-of-the-art MIL methods, achieving an improvement of 1.0% to 2.6% in accuracy and 0.7%-1.6% in AUROC.

📄 PDF Abstract BibTeX arXiv:2403.18134

Code (0)

등록된 구현이 없습니다.

Tasks

Multiple Instance Learning

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
LapEigen 설명 없음
Position-Wise Feed-Forward Layer 설명 없음
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

MGCT: Mutual-Guided Cross-Modality Transformer for Survival Outcome Prediction using Integrative Histopathology-Genomic Features

2023-11-20 · Mingxin Liu, Yunzan Liu, Hui Cui, Chunquan Li 외

The rapidly emerging field of deep learning-based computational pathology has shown promising results in utilizing whole slide images (WSIs) to objectively prognosticate cancer patients. However, most prognostic methods …

Prognosiswhole slide images

Kernel Attention Transformer (KAT) for Histopathology Whole Slide Image Classification

2022-06-27 · Yushan Zheng, Jun Li, Jun Shi, Fengying Xie 외

Transformer has been widely used in histopathology whole slide image (WSI) classification for the purpose of tumor grading, prognosis analysis, etc. However, the design of token-wise self-attention and positional embeddi…

Classificationimage-classificationImage ClassificationPrognosis

Automatic Report Generation for Histopathology images using pre-trained Vision Transformers

2023-11-10 · Saurav Sengupta, Donald E. Brown

Deep learning for histopathology has been successfully used for disease classification, image segmentation and more. However, combining image and text modalities using current state-of-the-art methods has been a challeng…

DecoderImage SegmentationSemantic Segmentationzero-shot-classification+1

Unleashing the Infinity Power of Geometry: A Novel Geometry-Aware Transformer (GOAT) for Whole Slide Histopathology Image Analysis

2024-02-08 · Mingxin Liu, Yunzan Liu, Pengbo Xu, Jiquan Ma

The histopathology analysis is of great significance for the diagnosis and prognosis of cancers, however, it has great challenges due to the enormous heterogeneity of gigapixel whole slide images (WSIs) and the intricate…

Prognosiswhole slide images

Automatic Report Generation for Histopathology images using pre-trained Vision Transformers and BERT

2023-12-03 · Saurav Sengupta, Donald E. Brown

Deep learning for histopathology has been successfully used for disease classification, image segmentation and more. However, combining image and text modalities using current state-of-the-art (SOTA) methods has been a c…

Caption GenerationDecoderHistopathological Image ClassificationImage Captioning+4