paper-with-me

홈 › Papers

Robust Metric Learning based on the Rescaled Hinge Loss

2019-04-26 · Sumia Abdulhussien Razooqi Al-Obaidi, Davood Zabihzadeh, Hamideh Hajiabadi

Distance/Similarity learning is a fundamental problem in machine learning. For example, kNN classifier or clustering methods are based on a distance/similarity measure. Metric learning algorithms enhance the efficiency of these methods by learning an optimal distance function from data. Most metric learning methods need training information in the form of pair or triplet sets. Nowadays, this training information often is obtained from the Internet via crowdsourcing methods. Therefore, this information may contain label noise or outliers leading to the poor performance of the learned metric. It is even possible that the learned metric functions perform worse than the general metrics such as Euclidean distance. To address this challenge, this paper presents a new robust metric learning method based on the Rescaled Hinge loss. This loss function is a general case of the popular Hinge loss and initially introduced in (Xu et al. 2017) to develop a new robust SVM algorithm. In this paper, we formulate the metric learning problem using the Rescaled Hinge loss function and then develop an efficient algorithm based on HQ (Half-Quadratic) to solve the problem. Experimental results on a variety of both real and synthetic datasets confirm that our new robust algorithm considerably outperforms state-of-the-art metric learning methods in the presence of label noise and outliers.

📄 PDF Abstract BibTeX arXiv:1904.11711

Code (1)

GT-Davood/Robust-metric-learning-based-on-the-rescaled-hinge-loss 공식 구현

Tasks

ClusteringMetric LearningTriplet

Methods 이 논문이 사용한 방법론

SVM A Support Vector Machine, or SVM, is a non-parametric supervised learning model. For non-linear classification and regression, they utilise the kernel trick to map inputs…

Similar Papers 제목 키워드 기반

Low-Rank Robust Online Distance/Similarity Learning based on the Rescaled Hinge Loss

2020-10-07 · Davood Zabihzadeh, Amar Tuama, Ali Karami-Mollaee

An important challenge in metric learning is scalability to both size and dimension of input data. Online metric learning algorithms are proposed to address this challenge. Existing methods are commonly based on (Passive…

Metric LearningTriplet

On the Dynamics Under the Unhinged Loss and Beyond

2023-12-13 · Xiong Zhou, Xianming Liu, Hanzhang Wang, Deming Zhai 외

Recent works have studied implicit biases in deep learning, especially the behavior of last-layer features and classifier weights. However, they usually need to simplify the intermediate dynamics under gradient flow or g…

Learning with Symmetric Label Noise: The Importance of Being Unhinged

2015-05-28 · NeurIPS 2015 12 · Brendan van Rooyen, Aditya Krishna Menon, Robert C. Williamson

Convex potential minimisation is the de facto approach to binary classification. However, Long and Servedio [2010] proved that under symmetric label noise (SLN), minimisation of any convex potential over a linear functio…

Binary ClassificationClassificationGeneral Classification

Online Convex Optimization with Unconstrained Domains and Losses

2017-03-07 · NeurIPS 2016 12 · Ashok Cutkosky, Kwabena Boahen

We propose an online convex optimization algorithm (RescaledExp) that achieves optimal regret in the unconstrained setting without prior knowledge of any bounds on the loss functions. We prove a lower bound showing an ex…

Hyperparameter Optimization

Support Vector Machine Classifier with Rescaled Huberized Pinball Loss

2025-11-27 · Shibo Diao arxiv

Support vector machines are widely used in machine learning classification tasks, but traditional SVM models suffer from sensitivity to outliers and instability in resampling, which limits their performance in practical …

Image Classification