paper-with-me

홈 › Papers

Mixing Histopathology Prototypes into Robust Slide-Level Representations for Cancer Subtyping

2023-10-19 · Joshua Butke, Noriaki Hashimoto, Ichiro Takeuchi, Hiroaki Miyoshi, Koichi Ohshima, Jun Sakuma

Whole-slide image analysis via the means of computational pathology often relies on processing tessellated gigapixel images with only slide-level labels available. Applying multiple instance learning-based methods or transformer models is computationally expensive as, for each image, all instances have to be processed simultaneously. The MLP-Mixer is an under-explored alternative model to common vision transformers, especially for large-scale datasets. Due to the lack of a self-attention mechanism, they have linear computational complexity to the number of input patches but achieve comparable performance on natural image datasets. We propose a combination of feature embedding and clustering to preprocess the full whole-slide image into a reduced prototype representation which can then serve as input to a suitable MLP-Mixer architecture. Our experiments on two public benchmarks and one inhouse malignant lymphoma dataset show comparable performance to current state-of-the-art methods, while achieving lower training costs in terms of computational time and memory load. Code is publicly available at https://github.com/butkej/ProtoMixer.

📄 PDF Abstract BibTeX arXiv:2310.12769

Code (1)

butkej/protomixer 공식 구현 pytorch

Tasks

Multiple Instance Learning

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Average Pooling 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Global Average Pooling Global Average Pooling is a pooling operation designed to replace fully connected layers in classical CNNs. The idea is to generate one feature map for each corresponding…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Residual Connection 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
MLP-Mixer 설명 없음

Similar Papers 제목 키워드 기반

Human-machine Interactive Tissue Prototype Learning for Label-efficient Histopathology Image Segmentation

2022-11-26 · Wentao Pan, Jiangpeng Yan, Hanbo Chen, Jiawei Yang 외

Recently, deep neural networks have greatly advanced histopathology image segmentation but usually require abundant annotated data. However, due to the gigapixel scale of whole slide images and pathologists' heavy daily …

Contrastive LearningImage SegmentationSegmentationSelf-Supervised Learning+3

SLPD: Slide-level Prototypical Distillation for WSIs

2023-07-20 · Zhimiao Yu, Tiancheng Lin, Yi Xu

Improving the feature representation ability is the foundation of many whole slide pathological image (WSIs) tasks. Recent works have achieved great success in pathological-specific self-supervised learning (SSL). Howeve…

Representation LearningSelf-Supervised Learning

PreMix: Addressing Label Scarcity in Whole Slide Image Classification with Pre-trained Multiple Instance Learning Aggregators

2024-08-02 · Bryan Wong, Mun Yong Yi

Multiple instance learning (MIL) has emerged as a powerful framework for weakly supervised whole slide image (WSI) classification, enabling slide-level predictions without requiring detailed patch-level annotations. Howe…

Active Learningimage-classificationImage ClassificationMultiple Instance Learning+1

ProtoPathway: Biologically Structured Prototype-Pathway Fusion for Multimodal Cancer Survival Prediction

2026-05-20 · Amaya Gallagher-Syed, Costantino Pitzalis, Myles J. Lewis, Michael R. Barnes 외 arxiv

We introduce ProtoPathway, an interpretable-by-design multimodal framework for cancer survival prediction that unifies whole slide imaging and transcriptomics through encoders producing biologically grounded representati…

Graph Neural Network

Histopathology Image Classification using Deep Manifold Contrastive Learning

2023-06-26 · Jing Wei Tan, Won-Ki Jeong

Contrastive learning has gained popularity due to its robustness with good feature representation performance. However, cosine distance, the commonly used similarity metric in contrastive learning, is not well suited to …

ClassificationClusteringContrastive Learningimage-classification+1