Magnification Invariant Medical Image Analysis: A Comparison of Convolutional Networks, Vision Transformers, and Token Mixers
Convolution Neural Networks (CNNs) are widely used in medical image analysis, but their performance degrade when the magnification of testing images differ from the training images. The inability of CNNs to generalize across magnification scales can result in sub-optimal performance on external datasets. This study aims to evaluate the robustness of various deep learning architectures in the analysis of breast cancer histopathological images with varying magnification scales at training and testing stages. Here we explore and compare the performance of multiple deep learning architectures, including CNN-based ResNet and MobileNet, self-attention-based Vision Transformers and Swin Transformers, and token-mixing models, such as FNet, ConvMixer, MLP-Mixer, and WaveMix. The experiments are conducted using the BreakHis dataset, which contains breast cancer histopathological images at varying magnification levels. We show that performance of WaveMix is invariant to the magnification of training and testing data and can provide stable and good classification accuracy. These evaluations are critical in identifying deep learning architectures that can robustly handle changes in magnification scale, ensuring that scale changes across anatomical structures do not disturb the inference results.
Code (0)
등록된 구현이 없습니다.
Tasks
Breast Cancer Histology Image ClassificationDeep LearningImage ClassificationMedical Image AnalysisMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Unsupervised Magnification of Posture Deviations Across Subjects
Analyzing human posture and precisely comparing it across different subjects is essential for accurate understanding of behavior and numerous vision applications such as medical diagnostics, sports, or surveillance. Moti…
Motion MagnificationMagnification-Aware Distillation (MAD): A Self-Supervised Framework for Unified Representation Learning in Gigapixel Whole-Slide Images
Whole-slide images (WSIs) contain tissue information distributed across multiple magnification levels, yet most self-supervised methods treat these scales as independent views. This separation prevents models from learni…
Representation LearningA Joint Spatial and Magnification Based Attention Framework for Large Scale Histopathology Classification
Deep learning has achieved great success in process- ing large size medical images such as histopathology slides. However, conventional deep learning methods cannot han- dle the enormous image sizes; instead, they spl…
Deep LearningSurgical Video Motion Magnification with Suppression of Instrument Artefacts
Video motion magnification could directly highlight subsurface blood vessels in endoscopic video in order to prevent inadvertent damage and bleeding. Applying motion filters to the full surgical image is however sensitiv…
Motion MagnificationSSIMSTB-VMM: Swin Transformer Based Video Motion Magnification
The goal of video motion magnification techniques is to magnify small motions in a video to reveal previously invisible or unseen movement. Its uses extend from bio-medical applications and deepfake detection to structur…
Motion Magnification