paper-with-me

Papers

Connections between Deep Equilibrium and Sparse Representation Models with Application to Hyperspectral Image Denoising

2022-03-29 · Alexandros Gkillas, Dimitris Ampeliotis, Kostas Berberidis

In this study, the problem of computing a sparse representation of multi-dimensional visual data is considered. In general, such data e.g., hyperspectral images, color images or video data consists of signals that exhibit strong local dependencies. A new computationally efficient sparse coding optimization problem is derived by employing regularization terms that are adapted to the properties of the signals of interest. Exploiting the merits of the learnable regularization techniques, a neural network is employed to act as structure prior and reveal the underlying signal dependencies. To solve the optimization problem Deep unrolling and Deep equilibrium based algorithms are developed, forming highly interpretable and concise deep-learning-based architectures, that process the input dataset in a block-by-block fashion. Extensive simulation results, in the context of hyperspectral image denoising, are provided, which demonstrate that the proposed algorithms outperform significantly other sparse coding approaches and exhibit superior performance against recent state-of-the-art deep-learning-based denoising models. In a wider perspective, our work provides a unique bridge between a classic approach, that is the sparse representation theory, and modern representation tools that are based on deep learning modeling.

📄 PDF Abstract BibTeX arXiv:2203.15901

Code (0)

등록된 구현이 없습니다.

Tasks

Deep LearningDenoisingHyperspectral Image DenoisingImage DenoisingRolling Shutter Correction

Similar Papers 제목 키워드 기반

Neural Cellular Automata and Deep Equilibrium Models

2025-01-07 · Zhibai Jia

This essay discusses the connections and differences between two emerging paradigms in deep learning, namely Neural Cellular Automata and Deep Equilibrium Models, and train a simple Deep Equilibrium Convolutional model t…

Thermodynamics of Reinforcement Learning Curricula

2026-03-12 · Jacob Adamczyk, Juan Sebastian Rojas, Rahul V. Kulkarni arxiv

Connections between statistical mechanics and machine learning have repeatedly proven fruitful, providing insight into optimization, generalization, and representation learning. In this work, we follow this tradition by …

Representation LearningReinforcement Learning

Time irreversibility and amplitude irreversibility measures for nonequilibrium processes

2020-08-19 · Wenpo Yao, Jun Wang, Matjaz Perc, Wenli Yao 외

Time irreversibility, which characterizes nonequilibrium processes, can be measured based on the probabilistic differences between symmetric vectors. To simplify the quantification of time irreversibility, symmetric perm…

Hyper-Connections

2024-09-29 · Defa Zhu, Hongzhi Huang, Zihao Huang, Yutao Zeng 외

We present hyper-connections, a simple yet effective method that can serve as an alternative to residual connections. This approach specifically addresses common drawbacks observed in residual connection variants, such a…

A Discontinuous Neural Network for Non-Negative Sparse Approximation

2016-03-21 · Martijn Arts, Marius Cordts, Monika Gorin, Marc Spehr 외

This paper investigates a discontinuous neural network which is used as a model of the mammalian olfactory system and can more generally be applied to solve non-negative sparse approximation problems. By inherently limit…

Denoising