paper-with-me

홈 › Papers

Safe rules for the identification of zeros in the solutions of the SLOPE problem

2021-10-22 · Clément Elvira, Cédric Herzet

In this paper we propose a methodology to accelerate the resolution of the so-called "Sorted L-One Penalized Estimation" (SLOPE) problem. Our method leverages the concept of "safe screening", well-studied in the literature for \textit{group-separable} sparsity-inducing norms, and aims at identifying the zeros in the solution of SLOPE. More specifically, we derive a set of \(\tfrac{n(n+1)}{2}\) inequalities for each element of the \(n\)-dimensional primal vector and prove that the latter can be safely screened if some subsets of these inequalities are verified. We propose moreover an efficient algorithm to jointly apply the proposed procedure to all the primal variables. Our procedure has a complexity \(\mathcal{O}(n\log n + LT)\) where \(T\leq n\) is a problem-dependent constant and \(L\) is the number of zeros identified by the tests. Numerical experiments confirm that, for a prescribed computational budget, the proposed methodology leads to significant improvements of the solving precision.

📄 PDF Abstract BibTeX arXiv:2110.11784

Code (1)

https://gitlab-research.centralesupelec.fr/2020elvirac/slope-screening 공식 구현

Similar Papers 제목 키워드 기반

Strong Screening Rules for Group-based SLOPE Models

2024-05-24 · Fabio Feser, Marina Evangelou

Tuning the regularization parameter in penalized regression models is an expensive task, requiring multiple models to be fit along a path of parameters. Strong screening rules drastically reduce computational costs by lo…

Deep Transfer Learning for Identifications of Slope Surface Cracks

2021-08-08 · Yuting Yang, Gang Mei

Geohazards such as landslides have caused great losses to the safety of people's lives and property, which is often accompanied with surface cracks. If such surface cracks could be identified in time, it is of great sign…

Transfer Learning

The Strong Screening Rule for SLOPE

2020-05-07 · NeurIPS 2020 12 · Johan Larsson, Małgorzata Bogdan, Jonas Wallin

Extracting relevant features from data sets where the number of observations ($n$) is much smaller then the number of predictors ($p$) is a major challenge in modern statistics. Sorted L-One Penalized Estimation (SLOPE),…

regression

Fast OSCAR and OWL with Safe Screening Rules

2020-01-01 · ICML 2020 1 · Runxue Bao, Bin Gu, Heng Huang

Ordered Weight $L_{1}$-Norms (OWL) is a new family of regularizers for high-dimensional sparse regression. However, due to the non-separable penalty, existing algorithms are either invalid or inefficient when either the …

regression

Slope Stability Analysis with Geometric Semantic Genetic Programming

2017-08-30 · Juncai Xu, Zhenzhong Shen, Qingwen Ren, Xin Xie 외

Genetic programming has been widely used in the engineering field. Compared with the conventional genetic programming and artificial neural network, geometric semantic genetic programming (GSGP) is superior in astringenc…

General Classificationregression