Patch Transformer for Multi-tagging Whole Slide Histopathology Images
Automated whole slide image (WSI) tagging has become a growing demand due to the increasing volume and diversity of WSIs collected nowadays in histopathology. Various methods have been studied to classify WSIs with single tags but none of them focuses on labeling WSIs with multiple tags. To this end, we propose a novel end-to-end trainable deep neural network named Patch Transformer which can effectively predict multiple slide-level tags from WSI patches based on both the correlations and the uniqueness between the tags. Specifically, the proposed method learns patch characteristics considering 1) patch-wise relations through a patch transformation module and 2) tag-wise uniqueness for each tagging task through a multi-tag attention module. Extensive experiments on a large and diverse dataset consisting of 4,920 WSIs prove the effectiveness of the proposed model.
Code (0)
등록된 구현이 없습니다.
Tasks
DiversityTAGMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
A self-supervised framework for learning whole slide representations
Whole slide imaging is fundamental to biomedical microscopy and computational pathology. Previously, learning representations for gigapixel-sized whole slide images (WSIs) has relied on multiple instance learning with we…
DiagnosticLanguage ModellingMultiple Instance LearningRepresentation Learning+2Cascaded Cross-Attention Networks for Data-Efficient Whole-Slide Image Classification Using Transformers
Whole-Slide Imaging allows for the capturing and digitization of high-resolution images of histological specimen. An automated analysis of such images using deep learning models is therefore of high demand. The transform…
image-classificationImage Classificationwhole slide imagesPATHS: A Hierarchical Transformer for Efficient Whole Slide Image Analysis
Computational analysis of whole slide images (WSIs) has seen significant research progress in recent years, with applications ranging across important diagnostic and prognostic tasks such as survival or cancer subtype pr…
DiagnosticRepresentation Learningwhole slide imagesMulti-scale Efficient Graph-Transformer for Whole Slide Image Classification
The multi-scale information among the whole slide images (WSIs) is essential for cancer diagnosis. Although the existing multi-scale vision Transformer has shown its effectiveness for learning multi-scale image represent…
image-classificationImage Classificationwhole slide imagesA Multimodal Knowledge-enhanced Whole-slide Pathology Foundation Model
Remarkable strides in computational pathology have been made in the task-agnostic foundation model that advances the performance of a wide array of downstream clinical tasks. Despite the promising performance, there are …
Diagnosticwhole slide images