paper-with-me

홈 › Papers

Loop Unrolled Shallow Equilibrium Regularizer (LUSER) -- A Memory-Efficient Inverse Problem Solver

2022-10-10 · Peimeng Guan, Jihui Jin, Justin Romberg, Mark A. Davenport

In inverse problems we aim to reconstruct some underlying signal of interest from potentially corrupted and often ill-posed measurements. Classical optimization-based techniques proceed by optimizing a data consistency metric together with a regularizer. Current state-of-the-art machine learning approaches draw inspiration from such techniques by unrolling the iterative updates for an optimization-based solver and then learning a regularizer from data. This loop unrolling (LU) method has shown tremendous success, but often requires a deep model for the best performance leading to high memory costs during training. Thus, to address the balance between computation cost and network expressiveness, we propose an LU algorithm with shallow equilibrium regularizers (LUSER). These implicit models are as expressive as deeper convolutional networks, but far more memory efficient during training. The proposed method is evaluated on image deblurring, computed tomography (CT), as well as single-coil Magnetic Resonance Imaging (MRI) tasks and shows similar, or even better, performance while requiring up to 8 times less computational resources during training when compared against a more typical LU architecture with feedforward convolutional regularizers.

📄 PDF Abstract BibTeX arXiv:2210.04987

Code (0)

등록된 구현이 없습니다.

Tasks

Computed Tomography (CT)DeblurringImage DeblurringRolling Shutter Correction

Similar Papers 제목 키워드 기반

Equilibrated Zeroth-Order Unrolled Deep Networks for Accelerated MRI

2021-12-18 · Zhuo-Xu Cui, Jing Cheng, Qingyong Zhu, Yuanyuan Liu 외

Recently, model-driven deep learning unrolls a certain iterative algorithm of a regularization model into a cascade network by replacing the first-order information (i.e., (sub)gradient or proximal operator) of the regul…

MRI ReconstructionRolling Shutter Correction

Learned Proximal Operator for Solving Seismic Deconvolution Problem

2023-07-19 · Peimeng Guan, Naveed Iqbal, Mark A. Davenport, Mudassir Masood

Seismic deconvolution is an essential step in seismic data processing that aims to extract layer information from noisy observed traces. In general, this is an ill-posed problem with non-unique solutions. Due to the spar…

Interpretable Lightweight Transformer via Unrolling of Learned Graph Smoothness Priors

2024-06-06 · Tam Thuc Do, Parham Eftekhar, Seyed Alireza Hosseini, Gene Cheung 외

We build interpretable and lightweight transformer-like neural networks by unrolling iterative optimization algorithms that minimize graph smoothness priors -- the quadratic graph Laplacian regularizer (GLR) and the $\el…

Graph Learning

Restarted contractive operators to learn at equilibrium

2025-06-16 · Leo Davy, Luis M. Briceno-Arias, N. Pustelnik

Bilevel optimization offers a methodology to learn hyperparameters in imaging inverse problems, yet its integration with automatic differentiation techniques remains challenging. On the one hand, inverse problems are typ…

Bilevel Optimization

Unrolling Plug-and-Play Gradient Graph Laplacian Regularizer for Image Restoration

2024-07-01 · Jianghe Cai, Gene Cheung, Fei Chen

Generic deep learning (DL) networks for image restoration like denoising and interpolation lack mathematical interpretability, require voluminous training data to tune a large parameter set, and are fragile in the face o…

DenoisingGraph LearningImage Restoration