paper-with-me

Papers

A survey of Transformer applications for histopathological image analysis: New developments and future directions

2023-09-25 · journal 2023 9 · Chukwuemeka Clinton Atabansi, Jing Nie, Haijun Liu, Qianqian Song, Lingfeng Yan, Xichuan Zhou

Transformers have been widely used in many computer vision challenges and have shown the capability of producing better results than convolutional neural networks (CNNs). Taking advantage of capturing long-range contextual information and learning more complex relations in the image data, Transformers have been used and applied to histopathological image processing tasks. In this survey, we make an effort to present a thorough analysis of the uses of Transformers in histopathological image analysis, covering several topics, from the newly built Transformer models to unresolved challenges. To be more precise, we first begin by outlining the fundamental principles of the attention mechanism included in Transformer models and other key frameworks. Second, we analyze Transformer-based applications in the histopathological imaging domain and provide a thorough evaluation of more than 100 research publications across different downstream tasks to cover the most recent innovations, including survival analysis and prediction, segmentation, classification, detection, and representation. Within this survey work, we also compare the performance of CNN-based techniques to Transformers based on recently published papers, highlight major challenges, and provide interesting future research directions. Despite the outstanding performance of the Transformer-based architectures in a number of papers reviewed in this survey, we anticipate that further improvements and exploration of Transformers in the histopathological imaging domain are still required in the future. We hope that this survey paper will give readers in this field of study a thorough understanding of Transformer-based techniques in histopathological image analysis, and an up-to-date paper list summary will be provided at https://github.com/S-domain/Survey-Paper.

📄 PDF Abstract BibTeX

Code (1)

S-domain/Survey-Paper

Tasks

SurveySurvival Analysis

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Position-Wise Feed-Forward Layer 설명 없음
Residual Connection 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Similar Papers 제목 키워드 기반

GasHis-Transformer: A Multi-scale Visual Transformer Approach for Gastric Histopathological Image Detection

2021-04-29 · HaoYuan Chen, Chen Li, Ge Wang, Xiaoyan Li 외

In this paper, a multi-scale visual transformer model, referred as GasHis-Transformer, is proposed for Gastric Histopathological Image Detection (GHID), which enables the automatic global detection of gastric cancer imag…

Adversarial AttackGeneral ClassificationHistopathological Image ClassificationImage Classification+1

Graph Neural Networks in Histopathology: Emerging Trends and Future Directions

2024-06-18 · Siemen Brussee, Giorgio Buzzanca, Anne M. R. Schrader, Jesper Kers

Histopathological analysis of Whole Slide Images (WSIs) has seen a surge in the utilization of deep learning methods, particularly Convolutional Neural Networks (CNNs). However, CNNs often fall short in capturing the int…

Graph structure learningwhole slide images

A State-of-the-art Survey of Artificial Neural Networks for Whole-slide Image Analysis:from Popular Convolutional Neural Networks to Potential Visual Transformers

2021-04-13 · Xintong Li, Weiming Hu, Chen Li, Tao Jiang 외

To increase the objectivity and accuracy of pathologists' work, artificial neural network(ANN) methods have been generally needed in the segmentation, classification, and detection of histopathological WSI. In this paper…

DCT-HistoTransformer: Efficient Lightweight Vision Transformer with DCT Integration for histopathological image analysis

2024-10-24 · Mahtab Ranjbar, Mehdi Mohebbi, Mahdi Cherakhloo, Bijan Vosoughi. Vahdat

In recent years, the integration of advanced imaging techniques and deep learning methods has significantly advanced computer-aided diagnosis (CAD) systems for breast cancer detection and classification. Transformers, wh…

Binary ClassificationBreast Cancer DetectionCancer ClassificationClassification+2

Towards Label-efficient Automatic Diagnosis and Analysis: A Comprehensive Survey of Advanced Deep Learning-based Weakly-supervised, Semi-supervised and Self-supervised Techniques in Histopathological Image Analysis

2022-08-18 · Linhao Qu, Siyu Liu, Xiaoyu Liu, Manning Wang 외

Histopathological images contain abundant phenotypic information and pathological patterns, which are the gold standards for disease diagnosis and essential for the prediction of patient prognosis and treatment outcome. …

PrognosisRepresentation LearningSelf-Supervised LearningWeakly-supervised Learning