paper-with-me

Papers

Ill-Conditioning in Dictionary-Based Dynamic-Equation Learning: A Systems Biology Case Study

2026-03-11 · Yuxiang Feng, Niall M Mangan, Manu Jayadharan arxiv

Data-driven discovery of governing equations from time-series data provides a powerful framework for understanding complex biological systems. Library-based approaches that use sparse regression over candidate functions have shown considerable promise, but they face a critical challenge when candidate functions become strongly correlated: numerical ill-conditioning. Poor or restricted sampling, together with particular choices of candidate libraries, can produce strong multicollinearity and numerical instability. In such cases, measurement noise may lead to widely different recovered models, obscuring the true underlying dynamics and hindering accurate system identification. Although sparse regularization promotes parsimonious solutions and can partially mitigate conditioning issues, strong correlations may persist, regularization may bias the recovered models, and the regression problem may remain highly sensitive to small perturbations in the data. We present a systematic analysis of how ill-conditioning affects sparse identification of biological dynamics using benchmark models from systems biology. We show that combinations involving as few as two or three terms can already exhibit strong multicollinearity and extremely large condition numbers. We further show that orthogonal polynomial bases do not consistently resolve ill-conditioning and can perform worse than monomial libraries when the data distribution deviates from the weight function associated with the orthogonal basis. Finally, we demonstrate that when data are sampled from distributions aligned with the appropriate weight functions corresponding to the orthogonal basis, numerical conditioning improves, and orthogonal polynomial bases can yield improved model recovery accuracy across two baseline models.

📄 PDF Abstract BibTeX arXiv:2603.11330

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Symbolic Regression via Neural Networks

2026-05-05 · Nibodh Boddupalli, Timothy Matchen, Jeff Moehlis arxiv

Identifying governing equations for a dynamical system is a topic of critical interest across an array of disciplines, from mathematics to engineering to biology. Machine learning -- specifically deep learning -- techniq…

EFiGP: Eigen-Fourier Physics-Informed Gaussian Process for Inference of Dynamic Systems

2025-01-23 · Jianhong Chen, Shihao Yang

Parameter estimation and trajectory reconstruction for data-driven dynamical systems governed by ordinary differential equations (ODEs) are essential tasks in fields such as biology, engineering, and physics. These inver…

Computational EfficiencyDenoisingNumerical Integrationparameter estimation+1

A non-autonomous equation discovery method for time signal classification

2020-11-22 · Ryeongkyung Yoon, Harish S. Bhat, Braxton Osting

Certain neural network architectures, in the infinite-layer limit, lead to systems of nonlinear differential equations. Motivated by this idea, we develop a framework for analyzing time signals based on non-autonomous dy…

ClassificationEquation DiscoveryGeneral Classification

Discovery of Nonlinear Dynamical Systems using a Runge-Kutta Inspired Dictionary-based Sparse Regression Approach

2021-05-11 · Pawan Goyal, Peter Benner

Discovering dynamical models to describe underlying dynamical behavior is essential to draw decisive conclusions and engineering studies, e.g., optimizing a process. Experimental data availability notwithstanding has inc…

Dictionary LearningExplainable ModelsNumerical Integrationregression

Koopman Identification of Nonlinear Systems via Reservoir Liftings

2026-05-06 · Weibin Gu, Chen Yang, Lu Shi arxiv

Learning tractable linear representations of nonlinear dynamical systems via Koopman operator theory is often hindered by dictionary selection, temporal memory encoding, and numerical ill-conditioning. Inspired by Reserv…