paper-with-me

홈 › Papers

Peer Loss Functions: Learning from Noisy Labels without Knowing Noise Rates

2019-10-08 · ICML 2020 1 · Yang Liu, Hongyi Guo

Learning with noisy labels is a common challenge in supervised learning. Existing approaches often require practitioners to specify noise rates, i.e., a set of parameters controlling the severity of label noises in the problem, and the specifications are either assumed to be given or estimated using additional steps. In this work, we introduce a new family of loss functions that we name as peer loss functions, which enables learning from noisy labels and does not require a priori specification of the noise rates. Peer loss functions work within the standard empirical risk minimization (ERM) framework. We show that, under mild conditions, performing ERM with peer loss functions on the noisy dataset leads to the optimal or a near-optimal classifier as if performing ERM over the clean training data, which we do not have access to. We pair our results with an extensive set of experiments. Peer loss provides a way to simplify model development when facing potentially noisy training labels, and can be promoted as a robust candidate loss function in such situations.

📄 PDF Abstract BibTeX arXiv:1910.03231

Code (2)

kumar10725/Keras-Determinant-based-Mutual-Information-loss-DMI-loss- tf
weijiaheng/Multi-class-Peer-Loss-functions pytorch

Tasks

Learning with noisy labels

Similar Papers 제목 키워드 기반

Normalized Loss Functions for Deep Learning with Noisy Labels

2020-06-24 · ICML 2020 1 · Xingjun Ma, Hanxun Huang, Yisen Wang, Simone Romano 외

Robust loss functions are essential for training accurate deep neural networks (DNNs) in the presence of noisy (incorrect) labels. It has been shown that the commonly used Cross Entropy (CE) loss is not robust to noisy l…

Deep LearningImage ClassificationLearning with noisy labels

PASS: Peer-Agreement based Sample Selection for training with Noisy Labels

2023-03-20 · Arpit Garg, Cuong Nguyen, Rafael Felix, Thanh-Toan Do 외

The prevalence of noisy-label samples poses a significant challenge in deep learning, inducing overfitting effects. This has, therefore, motivated the emergence of learning with noisy-label (LNL) techniques that focus on…

Co-matching: Combating Noisy Labels by Augmentation Anchoring

2021-03-23 · Yangdi Lu, Yang Bo, Wenbo He

Deep learning with noisy labels is challenging as deep neural networks have the high capacity to memorize the noisy labels. In this paper, we propose a learning algorithm called Co-matching, which balances the consistenc…

Learning with noisy labelsMemorization

Stochastically Dominant Peer Prediction

2025-06-02 · Yichi Zhang, Shengwei Xu, David Pennock, Grant Schoenebeck

Eliciting reliable human feedback is essential for many machine learning tasks, such as learning from noisy labels and aligning AI systems with human preferences. Peer prediction mechanisms incentivize truthful reporting…

FairnessPredictionSensitivity

Asymmetric Loss Functions for Learning with Noisy Labels

2021-06-06 · Xiong Zhou, Xianming Liu, Junjun Jiang, Xin Gao 외

Robust loss functions are essential for training deep neural networks with better generalization power in the presence of noisy labels. Symmetric loss functions are confirmed to be robust to label noise. However, the sym…

Learning with noisy labels