paper-with-me

Papers

c-lasso -- a Python package for constrained sparse and robust regression and classification

2020-11-02 · Léo Simpson, Patrick L. Combettes, Christian L. Müller

We introduce c-lasso, a Python package that enables sparse and robust linear regression and classification with linear equality constraints. The underlying statistical forward model is assumed to be of the following form: \[ y = X \beta + \sigma \epsilon \qquad \textrm{subject to} \qquad C\beta=0 \] Here, $X \in \mathbb{R}^{n\times d}$is a given design matrix and the vector $y \in \mathbb{R}^{n}$ is a continuous or binary response vector. The matrix $C$ is a general constraint matrix. The vector $\beta \in \mathbb{R}^{d}$ contains the unknown coefficients and $\sigma$ an unknown scale. Prominent use cases are (sparse) log-contrast regression with compositional data $X$, requiring the constraint $1_d^T \beta = 0$ (Aitchion and Bacon-Shone 1984) and the Generalized Lasso which is a special case of the described problem (see, e.g, (James, Paulson, and Rusmevichientong 2020), Example 3). The c-lasso package provides estimators for inferring unknown coefficients and scale (i.e., perspective M-estimators (Combettes and M\"uller 2020a)) of the form \[ \min_{\beta \in \mathbb{R}^d, \sigma \in \mathbb{R}_{0}} f\left(X\beta - y,{\sigma} \right) + \lambda \left\lVert \beta\right\rVert_1 \qquad \textrm{subject to} \qquad C\beta = 0 \] for several convex loss functions $f(\cdot,\cdot)$. This includes the constrained Lasso, the constrained scaled Lasso, and sparse Huber M-estimators with linear equality constraints.

📄 PDF Abstract BibTeX arXiv:2011.00898

Code (1)

Leo-Simpson/c-lasso 공식 구현

Tasks

General Classificationregression

Methods 이 논문이 사용한 방법론

Linear Regression Linear Regression is a method for modelling a relationship between a dependent variable and independent variables. These models can be fit with numerous approaches. The most…

Similar Papers 제목 키워드 기반

The flare Package for High Dimensional Linear Regression and Precision Matrix Estimation in R

2020-06-27 · Xingguo Li, Tuo Zhao, Xiaoming Yuan, Han Liu

This paper describes an R package named flare, which implements a family of new high dimensional regression methods (LAD Lasso, SQRT Lasso, $\ell_q$ Lasso, and Dantzig selector) and their extensions to sparse precision m…

regression

High-Dimensional Metrics in R

2016-03-05 · Victor Chernozhukov, Chris Hansen, Martin Spindler

The package High-dimensional Metrics (\Rpackage{hdm}) is an evolving collection of statistical methods for estimation and quantification of uncertainty in high-dimensional approximately sparse models. It focuses on provi…

regressionvalidVocal Bursts Intensity Prediction

PyDTS: A Python Package for Discrete-Time Survival (Regularized) Regression with Competing Risks

2022-04-12 · Tomer Meir, Rom Gutman, Malka Gorfine

Time-to-event analysis (survival analysis) is used when the response of interest is the time until a pre-specified event occurs. Time-to-event data are sometimes discrete either because time itself is discrete or due to …

regressionSurvival Analysis

PySINDy: A comprehensive Python package for robust sparse system identification

2021-11-12 · Alan A. Kaptanoglu, Brian M. de Silva, Urban Fasel, Kadierdan Kaheman 외

Automated data-driven modeling, the process of directly discovering the governing equations of a system from data, is increasingly being used across the scientific community. PySINDy is a Python package that provides too…

Model Discoveryregression

MyESL: Sparse learning in molecular evolution and phylogenetic analysis

2025-01-09 · Maxwell Sanderford, Sudip Sharma, Glen Stecher, Jun Liu 외

Evolutionary sparse learning (ESL) uses a supervised machine learning approach, Least Absolute Shrinkage and Selection Operator (LASSO), to build models explaining the relationship between a hypothesis and the variation …

Sparse Learning