paper-with-me

홈 › Papers

Robust and sparse support vector machine via hybrid truncated loss for supervised classification

2026-06-04 · Yuliang Yang, Chen Chen, Yuxiang Liu, Huiru Wang arxiv

The support vector machine (SVM) is a widely used classifier, but choosing an appropriate loss function remains difficult. Convex losses such as the hinge loss and least-squares loss are sensitive to outliers, while bounded non-convex losses often lead to high computational cost. To address this, we propose a hybrid truncated loss function ($L_{\mathrm{ht}}$) that is both sparse and bounded, and build the $L_{\mathrm{ht}}$-SVM model for single-view classification. We introduce the P-stationary point and use it to establish the first-order necessary and sufficient optimality conditions. Based on these conditions, we design an alternating direction method of multipliers with a working-set strategy that reduces computational cost and achieves global convergence. We further extend $L_{\mathrm{ht}}$-SVM to multi-view learning by adding structural information and view weights, resulting in Mv$L_{\mathrm{ht}}$-SVM, which follows both the consensus and complementarity principles. Experiments on synthetic, real-world, and image datasets show that $L_{\mathrm{ht}}$-SVM achieves higher accuracy with fewer support vectors and better noise robustness than five single-view methods, while Mv$L_{\mathrm{ht}}$-SVM outperforms six multi-view methods in accuracy, precision, recall, and F1-score.

📄 PDF Abstract BibTeX arXiv:2606.05814

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

An Inverse-free Truncated Rayleigh-Ritz Method for Sparse Generalized Eigenvalue Problem

2020-03-24 · Yunfeng Cai, Ping Li

This paper considers the sparse generalized eigenvalue problem (SGEP), which aims to find the leading eigenvector with at most $k$ nonzero entries. SGEP naturally arises in many applications in machine learning, statisti…

Quantum Algorithm for Sparse Online Learning with Truncated Gradient Descent

2024-11-06 · Debbie Lim, Yixian Qiu, Patrick Rebentrost, Qisheng Wang

Logistic regression, the Support Vector Machine (SVM), and least squares are well-studied methods in the statistical and computer science community, with various practical applications. High-dimensional data arriving on …

regression

Combining data assimilation and machine learning to infer unresolved scale parametrisation

2020-09-09 · Julien Brajard, Alberto Carrassi, Marc Bocquet, Laurent Bertino

In recent years, machine learning (ML) has been proposed to devise data-driven parametrisations of unresolved processes in dynamical numerical models. In most cases, the ML training leverages high-resolution simulations …

BIG-bench Machine Learning

Stabilized Sparse Online Learning for Sparse Data

2016-04-21 · Yuting Ma, Tian Zheng

Stochastic gradient descent (SGD) is commonly used for optimization in large-scale machine learning problems. Langford et al. (2009) introduce a sparse online learning method to induce sparsity via truncated gradient. Wi…

Analysis of Truncated Orthogonal Iteration for Sparse Eigenvector Problems

2021-03-24 · Hexuan Liu, Aleksandr Aravkin

A wide range of problems in computational science and engineering require estimation of sparse eigenvectors for high dimensional systems. Here, we propose two variants of the Truncated Orthogonal Iteration to compute mul…