Cyclic Generative Adversarial Networks With Congruent Image-Report Generation For Explainable Medical Image Analysis
We present a novel framework for explainable labeling and interpretation of medical images. Medical images require specialized professionals for interpretation, and are explained (typically) via elaborate textual reports. Different from prior methods that focus on medical report generation from images or vice-versa, we novelly generate congruent image--report pairs employing a cyclic-Generative Adversarial Network (cycleGAN); thereby, the generated report will adequately explain a medical image, while a report-generated image that effectively characterizes the text visually should (sufficiently) resemble the original. The aim of the work is to generate trustworthy and faithful explanations for the outputs of a model diagnosing chest x-ray images by pointing a human user to similar cases in support of a diagnostic decision. Apart from enabling transparent medical image labeling and interpretation, we achieve report and image-based labeling comparable to prior methods, including state-of-the-art performance in some cases as evidenced by experiments on the Indiana Chest X-ray dataset
Code (0)
등록된 구현이 없습니다.
Tasks
DiagnosticGenerative Adversarial NetworkMedical Image AnalysisMedical Report GenerationSimilar Papers 제목 키워드 기반
CSGAN: Cyclic-Synthesized Generative Adversarial Networks for Image-to-Image Transformation
The primary motivation of Image-to-Image Transformation is to convert an image of one domain to another domain. Most of the research has been focused on the task of image transformation for a set of pre-defined domains. …
Image GenerationSSIMDeep Cyclic Generative Adversarial Residual Convolutional Networks for Real Image Super-Resolution
Recent deep learning based single image super-resolution (SISR) methods mostly train their models in a clean data domain where the low-resolution (LR) and the high-resolution (HR) images come from noise-free settings (sa…
Generative Adversarial NetworkImage Super-ResolutionImage-to-Image TranslationSuper-Resolution+1Adversarial Evaluation of Multimodal Machine Translation
The promise of combining language and vision in multimodal machine translation is that systems will produce better translations by leveraging the image data. However, the evidence surrounding whether the images are usefu…
Machine TranslationMultimodal Machine Translationtext similarityTranslationCDGAN: Cyclic Discriminative Generative Adversarial Networks for Image-to-Image Transformation
Generative Adversarial Networks (GANs) have facilitated a new direction to tackle the image-to-image transformation problem. Different GANs use generator and discriminator networks with different losses in the objective …
A Parameterized Generative Adversarial Network Using Cyclic Projection for Explainable Medical Image Classification
Although current data augmentation methods are successful to alleviate the data insufficiency, conventional augmentation are primarily intra-domain while advanced generative adversarial networks (GANs) generate images re…
Data AugmentationGenerative Adversarial Networkimage-classificationImage Classification+1