paper-with-me

Papers

Neural Multigrid Architectures

2024-02-08 · Vladimir Fanaskov

We propose a convenient matrix-free neural architecture for the multigrid method. The architecture is simple enough to be implemented in less than fifty lines of code, yet it encompasses a large number of distinct multigrid solvers. We argue that a fixed neural network without dense layers can not realize an efficient iterative method. Because of that, standard training protocols do not lead to competitive solvers. To overcome this difficulty, we use parameter sharing and serialization of layers. The resulting network can be trained on linear problems with thousands of unknowns and retains its efficiency on problems with millions of unknowns. From the point of view of numerical linear algebra network's training corresponds to finding optimal smoothers for the geometric multigrid method. We demonstrate our approach on a few second-order elliptic equations. For tested linear systems, we obtain from two to five times smaller spectral radius of the error propagation matrix compare to a basic linear multigrid with Jacobi smoother.

📄 PDF Abstract BibTeX arXiv:2402.05563

Code (1)

vlsf/nmg 공식 구현

Similar Papers 제목 키워드 기반

Multigrid Neural Architectures

2016-11-23 · CVPR 2017 7 · Tsung-Wei Ke, Michael Maire, Stella X. Yu

We propose a multigrid extension of convolutional neural networks (CNNs). Rather than manipulating representations living on a single spatial grid, our network layers operate across scale space, on a pyramid of grids. Th…

Image ClassificationSemantic Segmentation

MGiaD: Multigrid in all dimensions. Efficiency and robustness by coarsening in resolution and channel dimensions

2022-11-10 · Antonia van Betteray, Matthias Rottmann, Karsten Kahl

Current state-of-the-art deep neural networks for image classification are made up of 10 - 100 million learnable weights and are therefore inherently prone to overfitting. The complexity of the weight count can be seen a…

Allimage-classificationImage Classification

Multigrid-in-Channels Architectures for Wide Convolutional Neural Networks

2020-06-11 · Jonathan Ephrath, Lars Ruthotto, Eran Treister

We present a multigrid approach that combats the quadratic growth of the number of parameters with respect to the number of channels in standard convolutional neural networks (CNNs). It has been shown that there is a red…

image-classificationImage Classification

Construction of Grid Operators for Multilevel Solvers: a Neural Network Approach

2021-09-13 · Claudio Tomasi, Rolf Krause

In this paper, we investigate the combination of multigrid methods and neural networks, starting from a Finite Element discretization of an elliptic PDE. Multigrid methods use interpolation operators to transfer informat…

FMG-Net and W-Net: Multigrid Inspired Deep Learning Architectures For Medical Imaging Segmentation

2023-04-05 · Adrian Celaya, Beatrice Riviere, David Fuentes

Accurate medical imaging segmentation is critical for precise and effective medical interventions. However, despite the success of convolutional neural networks (CNNs) in medical image segmentation, they still face chall…

Brain Tumor SegmentationImage SegmentationMedical Image SegmentationSegmentation+2