paper-with-me

홈 › Papers

Unsupervised Mutual Transformer Learning for Multi-Gigapixel Whole Slide Image Classification

2023-05-03 · Sajid Javed, Arif Mahmood, Talha Qaiser, Naoufel Werghi, Nasir Rajpoot

Classification of gigapixel Whole Slide Images (WSIs) is an important prediction task in the emerging area of computational pathology. There has been a surge of research in deep learning models for WSI classification with clinical applications such as cancer detection or prediction of molecular mutations from WSIs. Most methods require expensive and labor-intensive manual annotations by expert pathologists. Weakly supervised Multiple Instance Learning (MIL) methods have recently demonstrated excellent performance; however, they still require large slide-level labeled training datasets that need a careful inspection of each slide by an expert pathologist. In this work, we propose a fully unsupervised WSI classification algorithm based on mutual transformer learning. Instances from gigapixel WSI (i.e., image patches) are transformed into a latent space and then inverse-transformed to the original space. Using the transformation loss, pseudo-labels are generated and cleaned using a transformer label-cleaner. The proposed transformer-based pseudo-label generation and cleaning modules mutually train each other iteratively in an unsupervised manner. A discriminative learning mechanism is introduced to improve normal versus cancerous instance labeling. In addition to unsupervised classification, we demonstrate the effectiveness of the proposed framework for weak supervision for cancer subtype classification as downstream analysis. Extensive experiments on four publicly available datasets show excellent performance compared to the state-of-the-art methods. We intend to make the source code of our algorithm publicly available soon.

📄 PDF Abstract BibTeX arXiv:2305.02032

Code (0)

등록된 구현이 없습니다.

Tasks

Classificationimage-classificationImage ClassificationMultiple Instance LearningPseudo Labelwhole slide images

Similar Papers 제목 키워드 기반

MGCT: Mutual-Guided Cross-Modality Transformer for Survival Outcome Prediction using Integrative Histopathology-Genomic Features

2023-11-20 · Mingxin Liu, Yunzan Liu, Hui Cui, Chunquan Li 외

The rapidly emerging field of deep learning-based computational pathology has shown promising results in utilizing whole slide images (WSIs) to objectively prognosticate cancer patients. However, most prognostic methods …

Prognosiswhole slide images

Handcrafted Histological Transformer (H2T): Unsupervised Representation of Whole Slide Images

2022-02-14 · Quoc Dang Vu, Kashif Rajpoot, Shan E Ahmed Raza, Nasir Rajpoot

Diagnostic, prognostic and therapeutic decision-making of cancer in pathology clinics can now be carried out based on analysis of multi-gigapixel tissue images, also known as whole-slide images (WSIs). Recently, deep con…

Decision MakingDiagnosticwhole slide images

When an Image is Worth 1,024 x 1,024 Words: A Case Study in Computational Pathology

2023-12-06 · Wenhui Wang, Shuming Ma, Hanwen Xu, Naoto Usuyama 외

This technical report presents LongViT, a vision Transformer that can process gigapixel images in an end-to-end manner. Specifically, we split the gigapixel image into a sequence of millions of patches and project them l…

PrognosisSurvival Predictionwhole slide images

A self-supervised framework for learning whole slide representations

2024-02-09 · Xinhai Hou, Cheng Jiang, Akhil Kondepudi, Yiwei Lyu 외

Whole slide imaging is fundamental to biomedical microscopy and computational pathology. Previously, learning representations for gigapixel-sized whole slide images (WSIs) has relied on multiple instance learning with we…

DiagnosticLanguage ModellingMultiple Instance LearningRepresentation Learning+2

Scaling Vision Transformers to Gigapixel Images via Hierarchical Self-Supervised Learning

2022-06-06 · CVPR 2022 1 · Richard J. Chen, Chengkuan Chen, Yicong Li, Tiffany Y. Chen 외

Vision Transformers (ViTs) and their multi-scale and hierarchical variations have been successful at capturing image representations but their use has been generally studied for low-resolution images (e.g. - 256x256, 384…

Self-Supervised LearningSurvival Prediction