paper-with-me

홈 › Papers

On the Robustness of deep learning-based MRI Reconstruction to image transformations

2022-11-09 · Jinghan Jia, Mingyi Hong, Yimeng Zhang, Mehmet Akçakaya, Sijia Liu

Although deep learning (DL) has received much attention in accelerated magnetic resonance imaging (MRI), recent studies show that tiny input perturbations may lead to instabilities of DL-based MRI reconstruction models. However, the approaches of robustifying these models are underdeveloped. Compared to image classification, it could be much more challenging to achieve a robust MRI image reconstruction network considering its regression-based learning objective, limited amount of training data, and lack of efficient robustness metrics. To circumvent the above limitations, our work revisits the problem of DL-based image reconstruction through the lens of robust machine learning. We find a new instability source of MRI image reconstruction, i.e., the lack of reconstruction robustness against spatial transformations of an input, e.g., rotation and cutout. Inspired by this new robustness metric, we develop a robustness-aware image reconstruction method that can defend against both pixel-wise adversarial perturbations as well as spatial transformations. Extensive experiments are also conducted to demonstrate the effectiveness of our proposed approaches.

📄 PDF Abstract BibTeX arXiv:2211.04930

Code (0)

등록된 구현이 없습니다.

Tasks

image-classificationImage ClassificationImage ReconstructionMRI Reconstruction

Similar Papers 제목 키워드 기반

View Transformation Robustness for Multi-View 3D Object Reconstruction with Reconstruction Error-Guided View Selection

2024-12-16 · Qi Zhang, Zhouhang Luo, Tao Yu, Hui Huang

View transformation robustness (VTR) is critical for deep-learning-based multi-view 3D object reconstruction models, which indicates the methods' stability under inputs with various view transformations. However, existin…

3D Object Reconstruction3D ReconstructionObject Reconstruction

Robust Training Using Natural Transformation

2021-05-10 · Shuo Wang, Lingjuan Lyu, Surya Nepal, Carsten Rudolph 외

Previous robustness approaches for deep learning models such as data augmentation techniques via data transformation or adversarial training cannot capture real-world variations that preserve the semantics of the input, …

AttributeData Augmentationimage-classificationImage Classification+1

Detecting Near-Duplicate Face Images

2024-08-14 · Sudipta Banerjee, Arun Ross

Near-duplicate images are often generated when applying repeated photometric and geometric transformations that produce imperceptible variants of the original image. Consequently, a deluge of near-duplicates can be circu…

Using Videos to Evaluate Image Model Robustness

2019-04-22 · Keren Gu, Brandon Yang, Jiquan Ngiam, Quoc Le 외

Human visual systems are robust to a wide range of image transformations that are challenging for artificial networks. We present the first study of image model robustness to the minute transformations found across video…

model

Second-order Anisotropic Gaussian Directional Derivative Filters for Blob Detection

2023-04-30 · Jie Ren, Wenya Yu, Jiapan Guo, Weichuan Zhang 외

Interest point detection methods have received increasing attention and are widely used in computer vision tasks such as image retrieval and 3D reconstruction. In this work, second-order anisotropic Gaussian directional …

3D ReconstructionImage RetrievalInterest Point DetectionRetrieval