paper-with-me

Papers

Foundational Models in Medical Imaging: A Comprehensive Survey and Future Vision

2023-10-28 · Bobby Azad, Reza Azad, Sania Eskandari, Afshin Bozorgpour, Amirhossein Kazerouni, Islem Rekik, Dorit Merhof

Foundation models, large-scale, pre-trained deep-learning models adapted to a wide range of downstream tasks have gained significant interest lately in various deep-learning problems undergoing a paradigm shift with the rise of these models. Trained on large-scale dataset to bridge the gap between different modalities, foundation models facilitate contextual reasoning, generalization, and prompt capabilities at test time. The predictions of these models can be adjusted for new tasks by augmenting the model input with task-specific hints called prompts without requiring extensive labeled data and retraining. Capitalizing on the advances in computer vision, medical imaging has also marked a growing interest in these models. To assist researchers in navigating this direction, this survey intends to provide a comprehensive overview of foundation models in the domain of medical imaging. Specifically, we initiate our exploration by providing an exposition of the fundamental concepts forming the basis of foundation models. Subsequently, we offer a methodical taxonomy of foundation models within the medical domain, proposing a classification system primarily structured around training strategies, while also incorporating additional facets such as application domains, imaging modalities, specific organs of interest, and the algorithms integral to these models. Furthermore, we emphasize the practical use case of some selected approaches and then discuss the opportunities, applications, and future directions of these large-scale pre-trained models, for analyzing medical images. In the same vein, we address the prevailing challenges and research pathways associated with foundational models in medical imaging. These encompass the areas of interpretability, data management, computational requirements, and the nuanced issue of contextual comprehension.

📄 PDF Abstract BibTeX arXiv:2310.18689

Code (1)

mindflow-institue/awesome-foundation-models-in-medical-imaging 공식 구현

Similar Papers 제목 키워드 기반

Computation-Efficient Era: A Comprehensive Survey of State Space Models in Medical Image Analysis

2024-06-05 · Moein Heidari, Sina Ghorbani Kolahi, Sanaz Karimijafarbigloo, Bobby Azad 외

Sequence modeling plays a vital role across various domains, with recurrent neural networks being historically the predominant method of performing these tasks. However, the emergence of transformers has altered this par…

MambaMedical Image AnalysisNavigateRepresentation Learning+1

Neural Radiance Fields in Medical Imaging: A Survey

2024-02-26 · Xin Wang, Yineng Chen, Shu Hu, Heng Fan 외

Neural Radiance Fields (NeRF), as a pioneering technique in computer vision, offer great potential to revolutionize medical imaging by synthesizing three-dimensional representations from the projected two-dimensional ima…

NeRFSurvey

Implicit Neural Representation in Medical Imaging: A Comparative Survey

2023-07-30 · Amirali Molaei, Amirhossein Aminimehr, Armin Tavakoli, Amirhossein Kazerouni 외

Implicit neural representations (INRs) have gained prominence as a powerful paradigm in scene reconstruction and computer graphics, demonstrating remarkable results. By utilizing neural networks to parameterize data thro…

Domain AdaptationImage ReconstructionMedical Image AnalysisNovel View Synthesis+1

Deep Learning Approaches for Medical Imaging Under Varying Degrees of Label Availability: A Comprehensive Survey

2025-04-15 · Siteng Ma, Honghui Du, Yu An, Jing Wang 외

Deep learning has achieved significant breakthroughs in medical imaging, but these advancements are often dependent on large, well-annotated datasets. However, obtaining such datasets poses a significant challenge, as it…

image-classificationImage ClassificationMissing Labels

Continual Learning in Medical Imaging: A Survey and Practical Analysis

2024-05-22 · Mohammad Areeb Qazi, Anees Ur Rehman Hashmi, Santosh Sanjeev, Ibrahim Almakky 외

Deep Learning has shown great success in reshaping medical imaging, yet it faces numerous challenges hindering widespread application. Issues like catastrophic forgetting and distribution shifts in the continuously evolv…

Continual LearningSurvey