paper-with-me

홈 › Papers

A Novel Schur-Decomposition-Based Weight Projection Method for Stable State-Space Neural-Network Architectures

2026-05-14 · Sergio Vanegas, Lasse Lensu, Fredy Ruiz arxiv

Building black-box models for dynamical systems from data is a challenging problem in machine learning, especially when asymptotic stability guarantees are required. In this paper, we introduce a novel stability-ensuring and backpropagation-compatible projection scheme based on the Schur decomposition for the state matrix of linear discrete-time state-space layers, as well as an alternative pre-factorized formulation of the methodology. The proposed methods dynamically project the quasi-triangular factor of the state matrix's real Schur decomposition onto its nearest stable peer, ensuring stable dynamics with minimal overparameterization. Experiments on synthetic linear systems demonstrate that the method achieves accuracy and convergence rates comparable to those of state-of-the-art stable-system identification techniques, despite a marginal increase in computational complexity. Furthermore, the lower weight count facilitates convergence during training without sacrificing accuracy in stacked neural-network architectures with static nonlinearities targeting real-world datasets. These results suggest that the Schur-based projection provides a numerically robust framework for identifying complex dynamics on par with the State of the Art while satisfying strict asymptotic-stability requirements.

📄 PDF Abstract BibTeX arXiv:2605.14489

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

DAGGER: Gradient-Free Construction of Transiently Amplifying Networks under Hard Connectivity Constraints

2026-05-31 · James C. Ferguson arxiv

Many networks not only support but also rely on transient non-normal amplification, an orders-of-magnitude increase in the activity of an otherwise stable system. Constructing such networks under hard sign/sparsity/diago…

CSS-BA: Gate-Guided Column Space Search for Bundle Adjustment

2026-07-17 · Ayano Kaneda, Takafumi Taketomi, Shugo Yamaguchi, Shigeo Morishima arxiv

Bundle adjustment (BA) remains a critical refinement module for image-based 3D reconstruction and continues to improve geometric accuracy even in learning-based pipelines. However, in low-parallax and near-rotational reg…

3D Reconstruction

Non-normal Recurrent Neural Network (nnRNN): learning long time dependencies while improving expressivity with transient dynamics

2019-05-28 · NeurIPS 2019 12 · Giancarlo Kerg, Kyle Goyette, Maximilian Puelma Touzel, Gauthier Gidel 외

A recent strategy to circumvent the exploding and vanishing gradient problem in RNNs, and to allow the stable propagation of signals over long time scales, is to constrain recurrent connectivity matrices to be orthogonal…

Dissecting CLIP: Decomposition with a Schur Complement-based Approach

2024-12-24 · Azim Ospanov, Mohammad Jalali, Farzan Farnia

The use of CLIP embeddings to assess the alignment of samples produced by text-to-image generative models has been extensively explored in the literature. While the widely adopted CLIPScore, derived from the cosine simil…

Diversity

Simulating the Power Electronics-Dominated Grid using Schwarz-Schur Complement based Hybrid Domain Decomposition Algorithm

2022-12-09 · Fatemeh Kalantari, Jian Shi, Harish Krishnamoorthy

This paper proposes a novel two-stage hybrid domain decomposition algorithm to speed up the dynamic simulations and the analysis of power systems that can be computationally demanding due to the high penetration of renew…