Deep Unfolding-Aided Parameter Tuning for Plug-and-Play-Based Video Snapshot Compressive Imaging
Snapshot compressive imaging (SCI) captures high-dimensional data efficiently by compressing it into two-dimensional observations and reconstructing high-dimensional data from two-dimensional observations with various algorithms. The plug-and-play (PnP) method is a promising approach for the video SCI reconstruction because it can leverage both observation models and denoising methods for videos. Since the reconstruction accuracy significantly depends on the choice of noise level parameters, this paper proposes a deep unfolding-based method for tuning these parameters in PnP-based video SCI. For the training of the parameters, we prepare training data from the densely annotated video segmentation dataset, reparametrize the noise level parameters, and apply the checkpointing technique to reduce the required memory. Simulation results show that the trained noise level parameters via the proposed approach exhibit a non-monotonic pattern, which is different from the assumptions in the conventional convergence analyses of PnP-based algorithms. These findings provide new insights into both the application of deep unfolding and the theoretical basis of PnP algorithms.
Code (0)
등록된 구현이 없습니다.
Tasks
DenoisingVideo SegmentationVideo Semantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Plug-And-Play Learned Gaussian-mixture Approximate Message Passing
Deep unfolding showed to be a very successful approach for accelerating and tuning classical signal processing algorithms. In this paper, we propose learned Gaussian-mixture AMP (L-GM-AMP) - a plug-and-play compressed se…
compressed sensingDenoisingADMM-based Decoder for Binary Linear Codes Aided by Deep Learning
Inspired by the recent advances in deep learning (DL), this work presents a deep neural network aided decoding algorithm for binary linear codes. Based on the concept of deep unfolding, we design a decoding network by un…
DecoderDeep LearningPRISTA-Net: Deep Iterative Shrinkage Thresholding Network for Coded Diffraction Patterns Phase Retrieval
The problem of phase retrieval (PR) involves recovering an unknown image from limited amplitude measurement data and is a challenge nonlinear inverse problem in computational imaging and image processing. However, many o…
RetrievalPlug-Tagger: A Pluggable Sequence Labeling Framework Using Language Models
Plug-and-play functionality allows deep learning models to adapt well to different tasks without requiring any parameters modified. Recently, prefix-tuning was shown to be a plug-and-play method on various text generatio…
Language ModellingText GenerationLearning to Estimate RIS-Aided mmWave Channels
Inspired by the remarkable learning and prediction performance of deep neural networks (DNNs), we apply one special type of DNN framework, known as model-driven deep unfolding neural network, to reconfigurable intelligen…