paper-with-me

Papers

Improved Model based Deep Learning using Monotone Operator Learning (MOL)

2021-11-22 · Aniket Pramanik, Mathews Jacob

Model-based deep learning (MoDL) algorithms that rely on unrolling are emerging as powerful tools for image recovery. In this work, we introduce a novel monotone operator learning framework to overcome some of the challenges associated with current unrolled frameworks, including high memory cost, lack of guarantees on robustness to perturbations, and low interpretability. Unlike current unrolled architectures that use finite number of iterations, we use the deep equilibrium (DEQ) framework to iterate the algorithm to convergence and to evaluate the gradient of the convolutional neural network blocks using Jacobian iterations. This approach significantly reduces the memory demand, facilitating the extension of MoDL algorithms to high dimensional problems. We constrain the CNN to be a monotone operator, which allows us to introduce algorithms with guaranteed convergence properties and robustness guarantees. We demonstrate the utility of the proposed scheme in the context of parallel MRI.

📄 PDF Abstract BibTeX arXiv:2111.11380

Code (0)

등록된 구현이 없습니다.

Tasks

Deep LearningOperator learningRolling Shutter Correction

Similar Papers 제목 키워드 기반

Local monotone operator learning using non-monotone operators: MnM-MOL

2023-12-01 · Maneesh John, Jyothi Rikhab Chand, Mathews Jacob

The recovery of magnetic resonance (MR) images from undersampled measurements is a key problem that has seen extensive research in recent years. Unrolled approaches, which rely on end-to-end training of convolutional neu…

Operator learning

Non-Euclidean Enriched Contraction Theory for Monotone Operators and Monotone Dynamical Systems

2025-06-22 · Diego Deplano, Sergio Grammatico, Mauro Franceschelli

We adopt an operator-theoretic perspective to analyze a class of nonlinear fixed-point iterations and discrete-time dynamical systems. Specifically, we study the Krasnoselskij iteration - at the heart of countless algori…

Variance Reduced Halpern Iteration for Finite-Sum Monotone Inclusions

2023-10-04 · Xufeng Cai, Ahmet Alacaoglu, Jelena Diakonikolas

Machine learning approaches relying on such criteria as adversarial robustness or multi-agent settings have raised the need for solving game-theoretic equilibrium problems. Of particular relevance to these applications a…

Adversarial Robustness

On the Hypomonotone Class of Variational Inequalities

2024-10-11 · Khaled Alomar, Tatjana Chavdarova

This paper studies the behavior of the extragradient algorithm [Korpelevich, 1976] when applied to hypomonotone operators, a class of problems that extends beyond the classical monotone setting. To support the understand…

Monotone operator equilibrium networks

2020-06-15 · NeurIPS 2020 12 · Ezra Winston, J. Zico Kolter

Implicit-depth models such as Deep Equilibrium Networks have recently been shown to match or exceed the performance of traditional deep networks while being much more memory efficient. However, these models suffer from u…