paper-with-me

홈 › Papers

What a Whole Slide Image Can Tell? Subtype-guided Masked Transformer for Pathological Image Captioning

2023-10-31 · Wenkang Qin, Rui Xu, Peixiang Huang, Xiaomin Wu, Heyu Zhang, Lin Luo

Pathological captioning of Whole Slide Images (WSIs), though is essential in computer-aided pathological diagnosis, has rarely been studied due to the limitations in datasets and model training efficacy. In this paper, we propose a new paradigm Subtype-guided Masked Transformer (SGMT) for pathological captioning based on Transformers, which treats a WSI as a sequence of sparse patches and generates an overall caption sentence from the sequence. An accompanying subtype prediction is introduced into SGMT to guide the training process and enhance the captioning accuracy. We also present an Asymmetric Masked Mechansim approach to tackle the large size constraint of pathological image captioning, where the numbers of sequencing patches in SGMT are sampled differently in the training and inferring phases, respectively. Experiments on the PatchGastricADC22 dataset demonstrate that our approach effectively adapts to the task with a transformer-based model and achieves superior performance than traditional RNN-based methods. Our codes are to be made available for further research and development.

📄 PDF Abstract BibTeX arXiv:2310.20607

Code (0)

등록된 구현이 없습니다.

Tasks

Image CaptioningSentencewhole slide images

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Similar Papers 제목 키워드 기반

A Precision Diagnostic Framework of Renal Cell Carcinoma on Whole-Slide Images using Deep Learning

2021-10-26 · Jialun Wu, Haichuan Zhang, Zeyu Gao, Xinrui Bao 외

Diagnostic pathology, which is the basis and gold standard of cancer diagnosis, provides essential information on the prognosis of the disease and vital evidence for clinical treatment. Tumor region detection, subtype an…

ClassificationDiagnosticPrognosiswhole slide images

Patch-based Convolutional Neural Network for Whole Slide Tissue Image Classification

2015-04-29 · CVPR 2016 6 · Le Hou, Dimitris Samaras, Tahsin M. Kurc, Yi Gao 외

Convolutional Neural Networks (CNN) are state-of-the-art models for many image classification tasks. However, to recognize cancer subtypes automatically, training a CNN on gigapixel resolution Whole Slide Tissue Images (…

ClassificationGeneral Classificationimage-classificationImage Classification

SparseConvMIL: Sparse Convolutional Context-Aware Multiple Instance Learning for Whole Slide Image Classification

2021-05-06 · MICCAI Workshop COMPAY 2021 9 · Marvin Lerousseau, Maria Vakalopoulou, Eric Deutsch, Nikos Paragios

Multiple instance learning (MIL) is the preferred approach for whole slide image classification. However, most MIL approaches do not exploit the interdependencies of tiles extracted from a whole slide image, which could …

Classificationimage-classificationImage ClassificationMultiple Instance Learning+2

Efficient subtyping of ovarian cancer histopathology whole slide images using active sampling in multiple instance learning

2023-02-17 · Jack Breen, Katie Allen, Kieran Zucker, Geoff Hall 외

Weakly-supervised classification of histopathology slides is a computationally intensive task, with a typical whole slide image (WSI) containing billions of pixels to process. We propose Discriminative Region Active Samp…

ClassificationCPUGPUMultiple Instance Learning+2

Pan-Cancer Diagnostic Consensus Through Searching Archival Histopathology Images Using Artificial Intelligence

2019-11-20 · Shivam Kalra, H. R. Tizhoosh, Sultaan Shah, Charles Choi 외

The emergence of digital pathology has opened new horizons for histopathology and cytology. Artificial-intelligence algorithms are able to operate on digitized slides to assist pathologists with diagnostic tasks. Whereas…

DiagnosticGPUImage Retrievalwhole slide images