paper-with-me

홈 › Papers

Robust Capped lp-Norm Support Vector Ordinal Regression

2024-04-25 · Haorui Xiang, Zhichang Wu, Guoxu Li, Rong Wang, Feiping Nie, Xuelong Li

Ordinal regression is a specialized supervised problem where the labels show an inherent order. The order distinguishes it from normal multi-class problem. Support Vector Ordinal Regression, as an outstanding ordinal regression model, is widely used in many ordinal regression tasks. However, like most supervised learning algorithms, the design of SVOR is based on the assumption that the training data are real and reliable, which is difficult to satisfy in real-world data. In many practical applications, outliers are frequently present in the training set, potentially leading to misguide the learning process, such that the performance is non-optimal. In this paper, we propose a novel capped $\ell_{p}$-norm loss function that is theoretically robust to both light and heavy outliers. The capped $\ell_{p}$-norm loss can help the model detect and eliminate outliers during training process. Adhering to this concept, we introduce a new model, Capped $\ell_{p}$-Norm Support Vector Ordinal Regression(CSVOR), that is robust to outliers. CSVOR uses a weight matrix to detect and eliminate outliers during the training process to improve the robustness to outliers. Moreover, a Re-Weighted algorithm algorithm which is illustrated convergence by our theoretical results is proposed to effectively minimize the corresponding problem. Extensive experimental results demonstrate that our model outperforms state-of-the-art(SOTA) methods, particularly in the presence of outliers.

📄 PDF Abstract BibTeX arXiv:2404.16616

Code (0)

등록된 구현이 없습니다.

Tasks

regression

Similar Papers 제목 키워드 기반

Robust kernel-free quadratic surface twin support vector machine with capped $L_1$-norm distance metric

2024-05-27 · Qi Si, Zhi Xia Yang

Twin support vector machine (TSVM) is a very classical and practical classifier for pattern classification. However, the traditional TSVM has two limitations. Firstly, it uses the L_2-norm distance metric that leads to i…

On the Consistency of Ordinal Regression Methods

2014-08-11 · Fabian Pedregosa, Francis Bach, Alexandre Gramfort

Many of the ordinal regression models that have been proposed in the literature can be seen as methods that minimize a convex surrogate of the zero-one, absolute, or squared loss functions. A key property that allows to …

Binary ClassificationGeneral Classificationregression

SSN MLRG1 at SemEval-2018 Task 1: Emotion and Sentiment Intensity Detection Using Rule Based Feature Selection

2018-06-01 · SEMEVAL 2018 6 · Angel Deborah S, Rajalakshmi S, S Milton Rajendram, Mirnalinee T T

The system developed by the SSN MLRG1 team for Semeval-2018 task 1 on affect in tweets uses rule based feature selection and one-hot encoding to generate the input feature vector. Multilayer Perceptron was used to build …

Classificationfeature selectionGeneral ClassificationOrdinal Classification+2

Capped norm linear discriminant analysis and its applications

2020-11-04 · Jiakou Liu, Xiong Xiong, Pei-Wei Ren, Da Zhao 외

Classical linear discriminant analysis (LDA) is based on squared Frobenious norm and hence is sensitive to outliers and noise. To improve the robustness of LDA, in this paper, we introduce capped l_{2,1}-norm of a matrix…

A Novel Large-scale Ordinal Regression Model

2018-12-19 · Yong Shi, Huadong Wang, Xin Shen, Lingfeng Niu

Ordinal regression (OR) is a special multiclass classification problem where an order relation exists among the labels. Recent years, people share their opinions and sentimental judgments conveniently with social network…

modelregression