paper-with-me

홈 › Papers

Convex Hull Approximation of Nearly Optimal Lasso Solutions

2018-10-14 · Satoshi Hara, Takanori Maehara

In an ordinary feature selection procedure, a set of important features is obtained by solving an optimization problem such as the Lasso regression problem, and we expect that the obtained features explain the data well. In this study, instead of the single optimal solution, we consider finding a set of diverse yet nearly optimal solutions. To this end, we formulate the problem as finding a small number of solutions such that the convex hull of these solutions approximates the set of nearly optimal solutions. The proposed algorithm consists of two steps: First, we randomly sample the extreme points of the set of nearly optimal solutions. Then, we select a small number of points using a greedy algorithm. The experimental results indicate that the proposed algorithm can approximate the solution set well. The results also indicate that we can obtain Lasso solutions with a large diversity.

📄 PDF Abstract BibTeX arXiv:1810.05992

Code (1)

sato9hara/LassoHull

Tasks

Diversityfeature selection

Similar Papers 제목 키워드 기반

Linear Convergence of SVRG in Statistical Estimation

2016-11-07 · Chao Qu, Yan Li, Huan Xu

SVRG and its variants are among the state of art optimization algorithms for large scale machine learning problems. It is well known that SVRG converges linearly when the objective function is strongly convex. However th…

Convex Hull Prediction for Adaptive Video Streaming by Recurrent Learning

2022-06-10 · Somdyuti Paul, Andrey Norkin, Alan C. Bovik

Adaptive video streaming relies on the construction of efficient bitrate ladders to deliver the best possible visual quality to viewers under bandwidth constraints. The traditional method of content dependent bitrate lad…

Transfer Learning

Between steps: Intermediate relaxations between big-M and convex hull formulations

2021-01-29 · Jan Kronqvist, Ruth Misener, Calvin Tsay

This work develops a class of relaxations in between the big-M and convex hull formulations of disjunctions, drawing advantages from both. The proposed "P-split" formulations split convex additively separable constraints…

ClusteringForm

Sparse Approximate Conic Hulls

2017-12-01 · NeurIPS 2017 12 · Greg Van Buskirk, Benjamin Raichel, Nicholas Ruozzi

We consider the problem of computing a restricted nonnegative matrix factorization (NMF) of an m\times n matrix X. Specifically, we seek a factorization X\approx BC, where the k columns of B are a subset of those from X…

feature selection

Convex Hulls of Reachable Sets

2023-03-30 · Thomas Lew, Riccardo Bonalli, Marco Pavone

We study the convex hulls of reachable sets of nonlinear systems with bounded disturbances and uncertain initial conditions. Reachable sets play a critical role in control, but remain notoriously challenging to compute, …

Model Predictive Control