paper-with-me

홈 › Papers

IMEXnet: A Forward Stable Deep Neural Network

2019-03-06 · Eldad Haber, Keegan Lensink, Eran Treister, Lars Ruthotto

Deep convolutional neural networks have revolutionized many machine learning and computer vision tasks, however, some remaining key challenges limit their wider use. These challenges include improving the network's robustness to perturbations of the input image and the limited ``field of view'' of convolution operators. We introduce the IMEXnet that addresses these challenges by adapting semi-implicit methods for partial differential equations. Compared to similar explicit networks, such as residual networks, our network is more stable, which has recently shown to reduce the sensitivity to small changes in the input features and improve generalization. The addition of an implicit step connects all pixels in each channel of the image and therefore addresses the field of view problem while still being comparable to standard convolutions in terms of the number of parameters and computational complexity. We also present a new dataset for semantic segmentation and demonstrate the effectiveness of our architecture using the NYU Depth dataset.

📄 PDF Abstract BibTeX arXiv:1903.02639

Code (1)

HaberGroup/SemiImplicitDNNs 공식 구현 pytorch

Tasks

Semantic Segmentation

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Stable Inversion of Piecewise Affine Systems with Application to Feedforward and Iterative Learning Control

2024-04-15 · Isaac A. Spiegel, Nard Strijbosch, Robin de Rozario, Tom Oomen 외

Model inversion is a fundamental technique in feedforward control. Unstable inverse models present a challenge in that useful feedforward control trajectories cannot be generated by directly propagating them. Stable inve…

Stable Recurrent Models

2018-05-25 · ICLR 2019 5 · John Miller, Moritz Hardt

Stability is a fundamental property of dynamical systems, yet to this date it has had little bearing on the practice of recurrent neural networks. In this work, we conduct a thorough investigation of stable recurrent mod…

Stable behaviour of infinitely wide deep neural networks

2020-03-01 · Stefano Favaro, Sandra Fortini, Stefano Peluchetti

We consider fully connected feed-forward deep neural networks (NNs) where weights and biases are independent and identically distributed as symmetric centered stable distributions. Then, we show that the infinite wide li…

Gaussian Processes

On the Impact of Stable Ranks in Deep Nets

2021-10-05 · Bogdan Georgiev, Lukas Franken, Mayukh Mukherjee, Georgios Arvanitidis

A recent line of work has established intriguing connections between the generalization/compression properties of a deep neural network (DNN) model and the so-called layer weights' stable ranks. Intuitively, the latter a…

Natural Questions

Forward-Backward Extended DMD with an Asymptotic Stability Constraint

2024-03-15 · Louis Lortie, Steven Dahdah, James Richard Forbes

This paper presents a data-driven method to identify an asymptotically stable Koopman system from noisy data. In particular, the proposed approach combines approximations of the system's forward- and backward-in-time dyn…