A Survey on Deep Learning and Explainability for Automatic Report Generation from Medical Images
Every year physicians face an increasing demand of image-based diagnosis from patients, a problem that can be addressed with recent artificial intelligence methods. In this context, we survey works in the area of automatic report generation from medical images, with emphasis on methods using deep neural networks, with respect to: (1) Datasets, (2) Architecture Design, (3) Explainability and (4) Evaluation Metrics. Our survey identifies interesting developments, but also remaining challenges. Among them, the current evaluation of generated reports is especially weak, since it mostly relies on traditional Natural Language Processing (NLP) metrics, which do not accurately capture medical correctness.
Code (0)
등록된 구현이 없습니다.
Tasks
Medical Report GenerationSurveySimilar Papers 제목 키워드 기반
A Survey of Deep Learning-based Radiology Report Generation Using Multimodal Data
Automatic radiology report generation can alleviate the workload for physicians and minimize regional disparities in medical resources, therefore becoming an important topic in the medical image analysis field. It is a c…
Contrastive LearningKnowledge Base ConstructionMedical Image AnalysisSurveyFine-Grained Image-Text Alignment in Medical Imaging Enables Explainable Cyclic Image-Report Generation
To address these issues, we propose a novel Adaptive patch-word Matching (AdaMatch) model to correlate chest X-ray (CXR) image regions with words in medical reports and apply it to CXR-report generation to provide explai…
Language ModelingLanguage ModellingLarge Language ModelA Survey on Trustworthiness in Foundation Models for Medical Image Analysis
The rapid advancement of foundation models in medical imaging represents a significant leap toward enhancing diagnostic accuracy and personalized treatment. However, the deployment of foundation models in healthcare nece…
DiagnosticFairnessMedical Image AnalysisMedical Report Generation+1Interactive and Explainable Region-guided Radiology Report Generation
The automatic generation of radiology reports has the potential to assist radiologists in the time-consuming task of report writing. Existing methods generate the full report from image-level features, failing to explici…
Medical Report GenerationExplainable Automatic Hypothesis Generation via High-order Graph Walks
In this paper, we study the automatic hypothesis generation (HG) problem, focusing on explainability. Given pairs of biomedical terms, we focus on link prediction to explain how the prediction was made. This more transpa…
Link PredictionPredictionVocal Bursts Intensity Prediction