paper-with-me

홈 › Papers

Handcrafted Histological Transformer (H2T): Unsupervised Representation of Whole Slide Images

2022-02-14 · Quoc Dang Vu, Kashif Rajpoot, Shan E Ahmed Raza, Nasir Rajpoot

Diagnostic, prognostic and therapeutic decision-making of cancer in pathology clinics can now be carried out based on analysis of multi-gigapixel tissue images, also known as whole-slide images (WSIs). Recently, deep convolutional neural networks (CNNs) have been proposed to derive unsupervised WSI representations; these are attractive as they rely less on expert annotation which is cumbersome. However, a major trade-off is that higher predictive power generally comes at the cost of interpretability, posing a challenge to their clinical use where transparency in decision-making is generally expected. To address this challenge, we present a handcrafted framework based on deep CNN for constructing holistic WSI-level representations. Building on recent findings about the internal working of the Transformer in the domain of natural language processing, we break down its processes and handcraft them into a more transparent framework that we term as the Handcrafted Histological Transformer or H2T. Based on our experiments involving various datasets consisting of a total of 5,306 WSIs, the results demonstrate that H2T based holistic WSI-level representations offer competitive performance compared to recent state-of-the-art methods and can be readily utilized for various downstream analysis tasks. Finally, our results demonstrate that the H2T framework can be up to 14 times faster than the Transformer models.

📄 PDF Abstract BibTeX arXiv:2202.07001

Code (1)

vqdang/h2t 공식 구현 pytorch

Tasks

Decision MakingDiagnosticwhole slide images

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Multi-Head Attention 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Similar Papers 제목 키워드 기반

Unsupervised Artifact Detection for Whole Slide Images of Prostate Biopsies

2021-09-29 · ICLR 2022 · Amit Suveer, Walter de Back, Nadieh Khalili, Yijiang Chen 외

High-quality image digitisation of histological slides is essential for digital pathology to facilitate diagnosis and to develop reliable computer-aided assistance systems. Currently, image quality control (QC) to identi…

Artifact DetectionOne-Class Classificationwhole slide images

A Hierarchical Geometry-guided Transformer for Histological Subtyping of Primary Liver Cancer

2025-10-07 · Anwen Lu, Mingxin Liu, Yiping Jiao, Hongyi Gong 외 arxiv

Primary liver malignancies are widely recognized as the most heterogeneous and prognostically diverse cancers of the digestive system. Among these, hepatocellular carcinoma (HCC) and intrahepatic cholangiocarcinoma (ICC)…

BEL: A Bag Embedding Loss for Transformer enhances Multiple Instance Whole Slide Image Classification

2023-03-02 · Daniel Sens, Ario Sadafi, Francesco Paolo Casale, Nassir Navab 외

Multiple Instance Learning (MIL) has become the predominant approach for classification tasks on gigapixel histopathology whole slide images (WSIs). Within the MIL framework, single WSIs (bags) are decomposed into patche…

image-classificationImage ClassificationMultiple Instance Learningwhole slide images

Automating Whole Brain Histology to MRI Registration: Implementation of a Computational Pipeline

2019-05-22 · Maryana Alegro, Eduardo J. L. Alho, Maria da Graca Morais Martin, Lea Teneholz Grinberg 외

Although the latest advances in MRI technology have allowed the acquisition of higher resolution images, reliable delineation of cytoarchitectural or subcortical nuclei boundaries is not possible. As a result, histologic…

Masked Pre-Training of Transformers for Histology Image Analysis

2023-04-14 · Shuai Jiang, Liesbeth Hondelink, Arief A. Suriawinata, Saeed Hassanpour

In digital pathology, whole slide images (WSIs) are widely used for applications such as cancer diagnosis and prognosis prediction. Visual transformer models have recently emerged as a promising method for encoding large…

Multiple Instance LearningPrognosisSurvival Predictionwhole slide images