Kinetic Energy Plus Penalty Functions for Sparse Estimation
In this paper we propose and study a family of sparsity-inducing penalty functions. Since the penalty functions are related to the kinetic energy in special relativity, we call them \emph{kinetic energy plus} (KEP) functions. We construct the KEP function by using the concave conjugate of a $\chi^2$-distance function and present several novel insights into the KEP function with $q=1$. In particular, we derive a thresholding operator based on the KEP function, and prove its mathematical properties and asymptotic properties in sparsity modeling. Moreover, we show that a coordinate descent algorithm is especially appropriate for the KEP function. Additionally, we discuss the relationship of KEP with the penalty functions $\ell_{1/2}$ and MCP. The theoretical and empirical analysis validates that the KEP function is effective and efficient in high-dimensional data modeling.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Online Convex Optimization with Stochastic Constraints: Zero Constraint Violation and Bandit Feedback
This paper studies online convex optimization with stochastic constraints. We propose a variant of the drift-plus-penalty algorithm that guarantees $O(\sqrt{T})$ expected regret and zero constraint violation, after a fix…
LEMMADistributed Sparse Regression via Penalization
We study sparse linear regression over a network of agents, modeled as an undirected graph (with no centralized node). The estimation problem is formulated as the minimization of the sum of the local LASSO loss functions…
regressionA Lyapunov Drift-Plus-Penalty Method Tailored for Reinforcement Learning with Queue Stability
With the proliferation of Internet of Things (IoT) devices, the demand for addressing complex optimization challenges has intensified. The Lyapunov Drift-Plus-Penalty algorithm is a widely adopted approach for ensuring q…
reinforcement-learningReinforcement LearningReinforcement Learning (RL)Sparse Signal Estimation by Maximally Sparse Convex Optimization
This paper addresses the problem of sparsity penalized least squares for applications in sparse signal processing, e.g. sparse deconvolution. This paper aims to induce sparsity more strongly than L1 norm regularization, …
Smart Energy Management with Optimized Prosumerism for Achieving Dynamic Net-Zero Balance in Electrified Road Transport Networks
The increasing number of Electric Vehicles (EVs) have led to rising energy demands which aggregates the burden on grid supply. A few solutions have been proposed to reduce grid load, for example, using storage systems fo…
energy managementManagementScheduling