paper-with-me

홈 › Papers

Gap Safe Screening Rules for Fast Training of Robust Support Vector Machines under Feature Noise

2026-03-26 · Tan-Hau Nguyen, Thu-Le Tran, Kien Trung Nguyen arxiv

Robust Support Vector Machines (R-SVMs) address feature noise by adopting a worst-case robust formulation that explicitly incorporates uncertainty sets into training. While this robustness improves reliability, it also leads to increased computational cost. In this work, we develop safe sample screening rules for R-SVMs that reduce the training complexity without affecting the optimal solution. To the best of our knowledge, this is the first study to apply safe screening techniques to worst-case robust models in supervised machine learning. Our approach safely identifies training samples whose uncertainty sets are guaranteed to lie entirely on either side of the margin hyperplane, thereby reducing the problem size and accelerating optimization. Owing to the nonstandard structure of R-SVMs, the proposed screening rules are derived from the Lagrangian duality rather than the Fenchel-Rockafellar duality commonly used in recent methods. Based on this analysis, we first establish an ideal screening rule, and then derive a practical rule by adapting GAP-based safe regions to the robust setting. Experiments demonstrate that the proposed method significantly reduces training time while preserving classification accuracy.

📄 PDF Abstract BibTeX arXiv:2603.25221

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Mind the duality gap: safer rules for the Lasso

2015-05-13 · Olivier Fercoq, Alexandre Gramfort, Joseph Salmon

Screening rules allow to early discard irrelevant variables from the optimization in Lasso problems, or its derivatives, making solvers faster. In this paper, we propose new versions of the so-called $\textit{safe rules}…

Safe Sample Screening for Robust Support Vector Machine

2019-12-24 · Zhou Zhai, Bin Gu, Xiang Li, Heng Huang

Robust support vector machine (RSVM) has been shown to perform remarkably well to improve the generalization performance of support vector machine under the noisy environment. Unfortunately, in order to handle the non-co…

Safe screening rules for L0-regression

2020-01-01 · ICML 2020 1 · Alper Atamturk, Andres Gomez

We give safe screening rules to eliminate variables from regression with L0 regularization or cardinality constraint. These rules are based on guarantees that a feature may or may not be selected in an optimal solution. …

regression

Safe Screening Rules for $\ell_0$-Regression

2020-04-19 · Alper Atamtürk, Andrés Gómez

We give safe screening rules to eliminate variables from regression with $\ell_0$ regularization or cardinality constraint. These rules are based on guarantees that a feature may or may not be selected in an optimal solu…

regression

Scaling SVM and Least Absolute Deviations via Exact Data Reduction

2013-10-25 · Jie Wang, Peter Wonka, Jieping Ye

The support vector machine (SVM) is a widely used method for classification. Although many efforts have been devoted to develop efficient solvers, it remains challenging to apply SVM to large-scale problems. A nice prope…