paper-with-me

Papers

Transformers in Medical Imaging: A Survey

2022-01-24 · Fahad Shamshad, Salman Khan, Syed Waqas Zamir, Muhammad Haris Khan, Munawar Hayat, Fahad Shahbaz Khan, Huazhu Fu

Following unprecedented success on the natural language tasks, Transformers have been successfully applied to several computer vision problems, achieving state-of-the-art results and prompting researchers to reconsider the supremacy of convolutional neural networks (CNNs) as {de facto} operators. Capitalizing on these advances in computer vision, the medical imaging field has also witnessed growing interest for Transformers that can capture global context compared to CNNs with local receptive fields. Inspired from this transition, in this survey, we attempt to provide a comprehensive review of the applications of Transformers in medical imaging covering various aspects, ranging from recently proposed architectural designs to unsolved issues. Specifically, we survey the use of Transformers in medical image segmentation, detection, classification, reconstruction, synthesis, registration, clinical report generation, and other tasks. In particular, for each of these applications, we develop taxonomy, identify application-specific challenges as well as provide insights to solve them, and highlight recent trends. Further, we provide a critical discussion of the field's current state as a whole, including the identification of key challenges, open problems, and outlining promising future directions. We hope this survey will ignite further interest in the community and provide researchers with an up-to-date reference regarding applications of Transformer models in medical imaging. Finally, to cope with the rapid development in this field, we intend to regularly update the relevant latest papers and their open-source implementations at \url{https://github.com/fahadshamshad/awesome-transformers-in-medical-imaging}.

📄 PDF Abstract BibTeX arXiv:2201.09873

Code (1)

fahadshamshad/awesome-transformers-in-medical-imaging 공식 구현 paddle

Tasks

Image ClassificationImage SegmentationMedical Image DenoisingMedical Image RegistrationMedical Image SegmentationMedical Object DetectionMedical Report GenerationSemantic SegmentationSurvey

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Position-Wise Feed-Forward Layer 설명 없음
Adam 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Similar Papers 제목 키워드 기반

Vision Transformers in Medical Computer Vision -- A Contemplative Retrospection

2022-03-29 · Arshi Parvaiz, Muhammad Anwaar Khalid, Rukhsana Zafar, Huma Ameer 외

Recent escalation in the field of computer vision underpins a huddle of algorithms with the magnificent potential to unravel the information contained within images. These computer vision algorithms are being practised i…

Lesion DetectionMedical DiagnosisMedical Image Analysis

Computation-Efficient Era: A Comprehensive Survey of State Space Models in Medical Image Analysis

2024-06-05 · Moein Heidari, Sina Ghorbani Kolahi, Sanaz Karimijafarbigloo, Bobby Azad 외

Sequence modeling plays a vital role across various domains, with recurrent neural networks being historically the predominant method of performing these tasks. However, the emergence of transformers has altered this par…

MambaMedical Image AnalysisNavigateRepresentation Learning+1

Survey of AI-Powered Approaches for Osteoporosis Diagnosis in Medical Imaging

2025-09-29 · Abdul Rahman, Bumshik Lee arxiv

Osteoporosis silently erodes skeletal integrity worldwide; however, early detection through imaging can prevent most fragility fractures. Artificial intelligence (AI) methods now mine routine Dual-energy X-ray Absorptiom…

Self-Supervised Learning

A Comprehensive Survey of Mamba Architectures for Medical Image Analysis: Classification, Segmentation, Restoration and Beyond

2024-10-03 · Shubhi Bansal, Sreeharish A, Madhava Prasath J, Manikandan S 외

Mamba, a special case of the State Space Model, is gaining popularity as an alternative to template-based deep learning approaches in medical image analysis. While transformers are powerful architectures, they have drawb…

MambaMedical Image AnalysisState Space ModelsSurvey

CLIP in Medical Imaging: A Survey

2023-12-12 · Zihao Zhao, Yuxiao Liu, Han Wu, Mei Wang 외

Contrastive Language-Image Pre-training (CLIP), a simple yet effective pre-training paradigm, successfully introduces text supervision to vision models. It has shown promising results across various tasks due to its gene…

Medical Image AnalysisSurvey