paper-with-me

Papers

Optimizing Hard Thresholding for Sparse Model Discovery

2025-04-28 · Derek W. Jollie, Scott G. McCalla

Many model selection algorithms rely on sparse dictionary learning to provide interpretable and physics-based governing equations. The optimization algorithms typically use a hard thresholding process to enforce sparse activations in the model coefficients by removing library elements from consideration. By introducing an annealing scheme that reactivates a fraction of the removed terms with a cooling schedule, we are able to improve the performance of these sparse learning algorithms. We concentrate on two approaches to the optimization, SINDy, and an alternative using hard thresholding pursuit. We see in both cases that annealing can improve model accuracy. The effectiveness of annealing is demonstrated through comparisons on several nonlinear systems pulled from convective flows, excitable systems, and population dynamics. Finally we apply these algorithms to experimental data for projectile motion.

📄 PDF Abstract BibTeX arXiv:2504.20256

Code (0)

등록된 구현이 없습니다.

Tasks

Dictionary LearningmodelModel DiscoveryModel SelectionSparse Learning

Methods 이 논문이 사용한 방법론

Library 설명 없음

Similar Papers 제목 키워드 기반

Adaptive Iterative Hard Thresholding for Online High-dimensional Quantile Regression

2026-06-26 · Zitian Zhou, Nan Lin arxiv

Online high-dimensional regression requires algorithms that can update sequentially while preserving structural sparsity. We propose \textit{Adaptive Iterative Hard Thresholding (AIHT)}, an online sparse-regression frame…

Convergence of uncertainty estimates in Ensemble and Bayesian sparse model discovery

2023-01-30 · L. Mars Gao, Urban Fasel, Steven L. Brunton, J. Nathan Kutz

Sparse model identification enables nonlinear dynamical system discovery from data. However, the control of false discoveries for sparse model identification is challenging, especially in the low-data and high-noise limi…

Model DiscoveryregressionUncertainty Quantificationvalid+1

Dual Iterative Hard Thresholding: From Non-convex Sparse Minimization to Non-smooth Concave Maximization

2017-03-01 · ICML 2017 8 · Bo Liu, Xiao-Tong Yuan, Lezi Wang, Qingshan Liu 외

Iterative Hard Thresholding (IHT) is a class of projected gradient descent methods for optimizing sparsity-constrained minimization models, with the best known efficiency and scalability in practice. As far as we know, t…

Computational EfficiencyStochastic Optimization

Efficient High-Dimensional Data Representation Learning via Semi-Stochastic Block Coordinate Descent Methods

2019-09-25 · Bingkun Wei, Yangyang Li, Fanhua Shang, Yuanyuan Liu 외

With the increase of data volume and data dimension, sparse representation learning attracts more and more attention. For high-dimensional data, randomized block coordinate descent methods perform well because they do no…

Face RecognitionRepresentation Learning

Gradient Hard Thresholding Pursuit for Sparsity-Constrained Optimization

2013-11-22 · Xiao-Tong Yuan, Ping Li, Tong Zhang

Hard Thresholding Pursuit (HTP) is an iterative greedy selection procedure for finding sparse solutions of underdetermined linear systems. This method has been shown to have strong theoretical guarantee and impressive nu…

Compressive Sensingparameter estimationregression