paper-with-me

Papers

GroupCDL: Interpretable Denoising and Compressed Sensing MRI via Learned Group-Sparsity and Circulant Attention

2024-07-19 · Nikola Janjusevic, Amirhossein Khalilian-Gourtani, Adeen Flinker, Li Feng, Yao Wang

Nonlocal self-similarity within images has become an increasingly popular prior in deep-learning models. Despite their successful image restoration performance, such models remain largely uninterpretable due to their black-box construction. Our previous studies have shown that interpretable construction of a fully convolutional denoiser (CDLNet), with performance on par with state-of-the-art black-box counterparts, is achievable by unrolling a convolutional dictionary learning algorithm. In this manuscript, we seek an interpretable construction of a convolutional network with a nonlocal self-similarity prior that performs on par with black-box nonlocal models. We show that such an architecture can be effectively achieved by upgrading the L1 sparsity prior (soft-thresholding) of CDLNet to an image-adaptive group-sparsity prior (group-thresholding). The proposed learned group-thresholding makes use of nonlocal attention to perform spatially varying soft-thresholding on the latent representation. To enable effective training and inference on large images with global artifacts, we propose a novel circulant-sparse attention. We achieve competitive natural-image denoising performance compared to black-box nonlocal DNNs and transformers. The interpretable construction of our network allows for a straightforward extension to Compressed Sensing MRI (CS-MRI), yielding state-of-the-art performance. Lastly, we show robustness to noise-level mismatches between training and inference for denoising and CS-MRI reconstruction.

📄 PDF Abstract BibTeX arXiv:2407.18967

Code (1)

nikopj/cdlnet-ojsp pytorch

Tasks

compressed sensingDenoisingDictionary LearningImage DenoisingImage RestorationMRI Reconstruction

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음

Similar Papers 제목 키워드 기반

Compressed Sensing with Invertible Generative Models and Dependent Noise

2020-10-23 · Jay Whang, Qi Lei, Alex Dimakis

We study image inverse problems with invertible generative priors, specifically normalizing flow models. Our formulation views the solution as the maximum a posteriori (MAP) estimate of the image given the measurements. …

compressed sensingDenoising

Sparsity and Coefficient Permutation Based Two-Domain AMP for Image Block Compressed Sensing

2023-05-22 · Junhui Li, Xingsong Hou, Huake Wang, Shuhao Bi

The learned denoising-based approximate message passing (LDAMP) algorithm has attracted great attention for image compressed sensing (CS) tasks. However, it has two issues: first, its global measurement model severely re…

compressed sensingDeep AttentionDenoisingImage Compressed Sensing

A Flexible Framework for Designing Trainable Priors with Adaptive Smoothing and Game Encoding

2020-06-26 · NeurIPS 2020 12 · Bruno Lecouat, Jean Ponce, Julien Mairal

We introduce a general framework for designing and training neural network layers whose forward passes can be interpreted as solving non-smooth convex optimization problems, and whose architectures are derived from an op…

compressed sensingDenoisingDiversityImage Denoising+1

Denoising guarantees for optimized sampling schemes in compressed sensing

2025-04-01 · Yaniv Plan, Matthew S. Scott, Xia Sheng, Ozgur Yilmaz

Compressed sensing with subsampled unitary matrices benefits from \emph{optimized} sampling schemes, which feature improved theoretical guarantees and empirical performance relative to uniform subsampling. We provide, in…

compressed sensingDenoising

Variational Quantum Compressed Sensing for Joint User and Channel State Acquisition in Grant-Free Device Access Systems

2022-05-17 · Bryan Liu, Toshiaki Koike-Akino, Ye Wang, Kieran Parsons

This paper introduces a new quantum computing framework integrated with a two-step compressed sensing technique, applied to a joint channel estimation and user identification problem. We propose a variational quantum cir…

compressed sensingDenoisingUser Identification