On instabilities of deep learning in image reconstruction - Does AI come at a cost?
Deep learning, due to its unprecedented success in tasks such as image classification, has emerged as a new tool in image reconstruction with potential to change the field. In this paper we demonstrate a crucial phenomenon: deep learning typically yields unstablemethods for image reconstruction. The instabilities usually occur in several forms: (1) tiny, almost undetectable perturbations, both in the image and sampling domain, may result in severe artefacts in the reconstruction, (2) a small structural change, for example a tumour, may not be captured in the reconstructed image and (3) (a counterintuitive type of instability) more samples may yield poorer performance. Our new stability test with algorithms and easy to use software detects the instability phenomena. The test is aimed at researchers to test their networks for instabilities and for government agencies, such as the Food and Drug Administration (FDA), to secure safe use of deep learning methods.
Code (1)
Tasks
Deep Learningimage-classificationImage ClassificationImage ReconstructionSimilar Papers 제목 키워드 기반
Stabilizing Deep Tomographic Reconstruction
Tomographic image reconstruction with deep learning is an emerging field, but a recent landmark study reveals that several deep reconstruction networks are unstable for computed tomography (CT) and magnetic resonance ima…
Adversarial Attackcompressed sensingComputed Tomography (CT)Image ReconstructionInterval Neural Networks as Instability Detectors for Image Reconstructions
This work investigates the detection of instabilities that may occur when utilizing deep learning models for image reconstruction tasks. Although neural networks often empirically outperform traditional reconstruction me…
Deep LearningImage ReconstructionUncertainty QuantificationRegularizing Instabilities in Image Reconstruction Arising from Learned Denoisers
It's well-known that inverse problems are ill-posed and to solve them meaningfully one has to employ regularization methods. Traditionally, popular regularization methods have been the penalized Variational approaches. I…
Image ReconstructionRolling Shutter CorrectionOn Instabilities of Conventional Multi-Coil MRI Reconstruction to Small Adverserial Perturbations
Although deep learning (DL) has received much attention in accelerated MRI, recent studies suggest small perturbations may lead to instabilities in DL-based reconstructions, leading to concern for their clinical applicat…
MRI ReconstructionOn the Robustness of deep learning-based MRI Reconstruction to image transformations
Although deep learning (DL) has received much attention in accelerated magnetic resonance imaging (MRI), recent studies show that tiny input perturbations may lead to instabilities of DL-based MRI reconstruction models. …
image-classificationImage ClassificationImage ReconstructionMRI Reconstruction