paper-with-me

홈 › Papers

Is Ordered Weighted $\ell_1$ Regularized Regression Robust to Adversarial Perturbation? A Case Study on OSCAR

2018-09-24 · Pin-Yu Chen, Bhanukiran Vinzamuri, Sijia Liu

Many state-of-the-art machine learning models such as deep neural networks have recently shown to be vulnerable to adversarial perturbations, especially in classification tasks. Motivated by adversarial machine learning, in this paper we investigate the robustness of sparse regression models with strongly correlated covariates to adversarially designed measurement noises. Specifically, we consider the family of ordered weighted $\ell_1$ (OWL) regularized regression methods and study the case of OSCAR (octagonal shrinkage clustering algorithm for regression) in the adversarial setting. Under a norm-bounded threat model, we formulate the process of finding a maximally disruptive noise for OWL-regularized regression as an optimization problem and illustrate the steps towards finding such a noise in the case of OSCAR. Experimental results demonstrate that the regression performance of grouping strongly correlated features can be severely degraded under our adversarial setting, even when the noise budget is significantly smaller than the ground-truth signals.

📄 PDF Abstract BibTeX arXiv:1809.08706

Code (0)

등록된 구현이 없습니다.

Tasks

BIG-bench Machine LearningClusteringregression

Similar Papers 제목 키워드 기반

An $O(n\log(n))$ Algorithm for Projecting Onto the Ordered Weighted $\ell_1$ Norm Ball

2015-05-05 · Damek Davis

The ordered weighted $\ell_1$ (OWL) norm is a newly developed generalization of the Octogonal Shrinkage and Clustering Algorithm for Regression (OSCAR) norm. This norm has desirable statistical properties and can be used…

Clusteringregression

Adversarial Regression with Doubly Non-negative Weighting Matrices

2021-09-30 · NeurIPS 2021 12 · Tam Le, Truyen Nguyen, Makoto Yamada, Jose Blanchet 외

Many machine learning tasks that involve predicting an output response can be solved by training a weighted regression model. Unfortunately, the predictive power of this type of models may severely deteriorate under low …

regression

Fast OSCAR and OWL Regression via Safe Screening Rules

2020-06-29 · Runxue Bao, Bin Gu, Heng Huang

Ordered Weighted $L_{1}$ (OWL) regularized regression is a new regression analysis for high-dimensional sparse learning. Proximal gradient methods are used as standard approaches to solve OWL regression. However, it is s…

regressionSparse Learning

Deterministic Gaussian Averaged Neural Networks

2020-06-10 · Ryan Campbell, Chris Finlay, Adam M. Oberman

We present a deterministic method to compute the Gaussian average of neural networks used in regression and classification. Our method is based on an equivalence between training with a particular regularized loss, and t…

Adversarial Robustnessregression

Learning Gaussian Graphical Models with Ordered Weighted L1 Regularization

2019-06-06 · Cody Mazza-Anthony, Bogdan Mazoure, Mark Coates

We address the task of identifying densely connected subsets of multivariate Gaussian random variables within a graphical model framework. We propose two novel estimators based on the Ordered Weighted $\ell_1$ (OWL) norm…

Computational Efficiency