paper-with-me

홈 › Papers

Rational Optimization for Nonlinear Reconstruction with Approximate $\ell_0$ Penalization

2018-12-21

Recovering nonlinearly degraded signal in the presence of noise is a challenging problem. In this work, this problem is tackled by minimizing the sum of a non convex least-squares fit criterion and a penalty term. We assume that the nonlinearity of the model can be accounted for by a rational function. In addition, we suppose that the signal to be sought is sparse and a rational approximation of the $\ell_0$ pseudo-norm thus constitutes a suitable penalization. The resulting composite cost function belongs to the broad class of semi-algebraic functions. To find a globally optimal solution to such an optimization problem, it can be transformed into a generalized moment problem, for which a hierarchy of semidefinite programming relaxations can be built. Global optimality comes at the expense of an increased dimension and, to overcome computational limitations concerning the number of involved variables, the structure of the problem has to be carefully addressed. A situation of practical interest is when the nonlinear model consists of a convolutive transform followed by a componentwise nonlinear rational saturation. We then propose to use a sparse relaxation able to deal with up to several hundreds of optimized variables. In contrast with the naive approach consisting of linearizing the model, our experiments show that the proposed approach offers good performance.

📄 PDF Abstract BibTeX arXiv:1808.00724

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Sparse Signal Reconstruction for Nonlinear Models via Piecewise Rational Optimization

2020-10-29 · Arthur Marmin, Marc Castella, Jean-Christophe Pesquet, Laurent Duval

We propose a method to reconstruct sparse signals degraded by a nonlinear distortion and acquired at a limited sampling rate. Our method formulates the reconstruction problem as a nonconvex minimization of the sum of a d…

Alleviating Overfitting in Transformation-Interaction-Rational Symbolic Regression with Multi-Objective Optimization

2025-01-03 · Fabricio Olivetti de Franca

The Transformation-Interaction-Rational is a representation for symbolic regression that limits the search space of functions to the ratio of two nonlinear functions each one defined as the linear regression of transform…

regressionSymbolic Regression

Entropy Martingale Optimal Transport and Nonlinear Pricing-Hedging Duality

2020-05-26 · Alessandro Doldi, Marco Frittelli

The objective of this paper is to develop a duality between a novel Entropy Martingale Optimal Transport problem (A) and an associated optimization problem (B). In (A) we follow the approach taken in the Entropy Optimal …

Math

Rational Sparse Autoencoder

2026-06-12 · Naiyu Yin, Yue Yu arxiv

Sparse autoencoders (SAEs) are standard tools for mechanistic interpretability, but current SAE families are constrained by fixed encoder nonlinearities such as ReLU, JumpReLU, and TopK. This hard-codes a particular spar…

An explicit analysis of the entropic penalty in linear programming

2018-06-05 · Jonathan Weed

Solving linear programs by using entropic penalization has recently attracted new interest in the optimization community, since this strategy forms the basis for the fastest-known algorithms for the optimal transport pro…

valid