Recurrent Spectral Network (RSN): shaping the basin of attraction of a discrete map to reach automated classification
A novel strategy to automated classification is introduced which exploits a fully trained dynamical system to steer items belonging to different categories toward distinct asymptotic attractors. These latter are incorporated into the model by taking advantage of the spectral decomposition of the operator that rules the linear evolution across the processing network. Non-linear terms act for a transient and allow to disentangle the data supplied as initial condition to the discrete dynamical system, shaping the boundaries of different attractors. The network can be equipped with several memory kernels which can be sequentially activated for serial datasets handling. Our novel approach to classification, that we here term Recurrent Spectral Network (RSN), is successfully challenged against a simple test-bed model, created for illustrative purposes, as well as a standard dataset for image processing training.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Data-based stabilization of unknown bilinear systems with guaranteed basin of attraction
Motivated by the goal of having a building block in the direct design of data-driven controllers for nonlinear systems, we show how, for an unknown discrete-time bilinear system, the data collected in an offline open-loo…
Basins of Attraction to Multiple Fixed Points in Discrete-time Hysteresis Neural Networks
This paper studies multiple fixed points in a discrete-time hysteresis neural network. The network consists of binary hysteresis neurons characterized by the threshold parameter. Depending on the parameter, the network c…
Classifier-Free Guidance inside the Attraction Basin May Cause Memorization
Diffusion models are prone to exactly reproduce images from the training data. This exact reproduction of the training data is concerning as it can lead to copyright infringement and/or leakage of privacy-sensitive infor…
DenoisingMemorizationTopological properties of basins of attraction and expressiveness of width bounded neural networks
In Radhakrishnan et al. [2020], the authors empirically show that autoencoders trained with usual SGD methods shape out basins of attraction around their training data. We consider network functions of width not exceedin…
Entropic Confinement and Mode Connectivity in Overparameterized Neural Networks
Modern neural networks exhibit a striking property: basins of attraction in the loss landscape are often connected by low-loss paths, yet optimization dynamics generally remain confined to a single convex basin and rarel…