paper-with-me

Papers

Histopathological Image Classification based on Self-Supervised Vision Transformer and Weak Labels

2022-10-17 · Ahmet Gokberk Gul, Oezdemir Cetin, Christoph Reich, Tim Prangemeier, Nadine Flinner, Heinz Koeppl

Whole Slide Image (WSI) analysis is a powerful method to facilitate the diagnosis of cancer in tissue samples. Automating this diagnosis poses various issues, most notably caused by the immense image resolution and limited annotations. WSIs commonly exhibit resolutions of 100Kx100K pixels. Annotating cancerous areas in WSIs on the pixel level is prohibitively labor-intensive and requires a high level of expert knowledge. Multiple instance learning (MIL) alleviates the need for expensive pixel-level annotations. In MIL, learning is performed on slide-level labels, in which a pathologist provides information about whether a slide includes cancerous tissue. Here, we propose Self-ViT-MIL, a novel approach for classifying and localizing cancerous areas based on slide-level annotations, eliminating the need for pixel-wise annotated training data. Self-ViT- MIL is pre-trained in a self-supervised setting to learn rich feature representation without relying on any labels. The recent Vision Transformer (ViT) architecture builds the feature extractor of Self-ViT-MIL. For localizing cancerous regions, a MIL aggregator with global attention is utilized. To the best of our knowledge, Self-ViT- MIL is the first approach to introduce self-supervised ViTs in MIL-based WSI analysis tasks. We showcase the effectiveness of our approach on the common Camelyon16 dataset. Self-ViT-MIL surpasses existing state-of-the-art MIL-based approaches in terms of accuracy and area under the curve (AUC).

📄 PDF Abstract BibTeX arXiv:2210.09021

Code (1)

gokberkgul/self-learning-transformer-mil 공식 구현 pytorch

Tasks

Histopathological Image Classificationimage-classificationImage ClassificationMultiple Instance Learning

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Multi-Head Attention 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

GenSelfDiff-HIS: Generative Self-Supervision Using Diffusion for Histopathological Image Segmentation

2023-09-04 · Vishnuvardhan Purma, Suhas Srinath, Seshan Srirangarajan, Aanchal Kakkar 외

Histopathological image segmentation is a laborious and time-intensive task, often requiring analysis from experienced pathologists for accurate examinations. To reduce this burden, supervised machine-learning approaches…

Histopathological SegmentationImage SegmentationImage-to-Image TranslationSegmentation+2

Beyond Labels: A Self-Supervised Framework with Masked Autoencoders and Random Cropping for Breast Cancer Subtype Classification

2024-10-15 · Annalisa Chiocchetti, Marco Dossena, Christopher Irwin, Luigi Portinale

This work contributes to breast cancer sub-type classification using histopathological images. We utilize masked autoencoders (MAEs) to learn a self-supervised embedding tailored for computer vision tasks in this domain.…

Multi-class Classification

Self-distillation Augmented Masked Autoencoders for Histopathological Image Classification

2022-03-31 · Yang Luo, Zhineng Chen, Shengtian Zhou, Xieping Gao

Self-supervised learning (SSL) has drawn increasing attention in histopathological image analysis in recent years. Compared to contrastive learning which is troubled with the false negative problem, i.e., semantically si…

Cell SegmentationClassificationContrastive LearningHistopathological Image Classification+5

Supervised Contrastive Vision Transformer for Breast Histopathological Image Classification

2024-04-17 · Mohammad Shiri, Monalika Padma Reddy, Jiangwen Sun

Invasive ductal carcinoma (IDC) is the most prevalent form of breast cancer. Breast tissue histopathological examination is critical in diagnosing and classifying breast cancer. Although existing methods have shown promi…

ClassificationContrastive LearningHistopathological Image Classificationimage-classification+3

Pseudo-Data based Self-Supervised Federated Learning for Classification of Histopathological Images

2022-05-31 · Jun Shi, Yuanming Zhang, Zheng Li, Xiangmin Han 외

Computer-aided diagnosis (CAD) can help pathologists improve diagnostic accuracy together with consistency and repeatability for cancers. However, the CAD models trained with the histopathological images only from a sing…

Contrastive LearningDiagnosticFederated LearningSelf-Supervised Learning