paper-with-me

홈 › Papers

Unleashing the Potential of Regularization Strategies in Learning with Noisy Labels

2023-07-11 · Hui Kang, Sheng Liu, Huaxi Huang, Jun Yu, Bo Han, Dadong Wang, Tongliang Liu

In recent years, research on learning with noisy labels has focused on devising novel algorithms that can achieve robustness to noisy training labels while generalizing to clean data. These algorithms often incorporate sophisticated techniques, such as noise modeling, label correction, and co-training. In this study, we demonstrate that a simple baseline using cross-entropy loss, combined with widely used regularization strategies like learning rate decay, model weights average, and data augmentations, can outperform state-of-the-art methods. Our findings suggest that employing a combination of regularization strategies can be more effective than intricate algorithms in tackling the challenges of learning with noisy labels. While some of these regularization strategies have been utilized in previous noisy label learning research, their full potential has not been thoroughly explored. Our results encourage a reevaluation of benchmarks for learning with noisy labels and prompt reconsideration of the role of specialized learning algorithms designed for training with noisy labels.

📄 PDF Abstract BibTeX arXiv:2307.05025

Code (0)

등록된 구현이 없습니다.

Tasks

Learning with noisy labels

Similar Papers 제목 키워드 기반

Max-Margin Majority Voting for Learning from Crowds

2015-12-01 · NeurIPS 2015 12 · Tian Tian, Jun Zhu

Learning-from-crowds aims to design proper aggregation strategies to infer the unknown true labels from the noisy labels provided by ordinary web workers. This paper presents max-margin majority voting (M^3V) to improve …

Bayesian Inference

Potential Energy based Mixture Model for Noisy Label Learning

2024-05-02 · Zijia Wang, Wenbin Yang, ZhiSong Liu, Zhen Jia

Training deep neural networks (DNNs) from noisy labels is an important and challenging task. However, most existing approaches focus on the corrupted labels and ignore the importance of inherent data structure. To bridge…

Unleashing the Potential of Open-set Noisy Samples Against Label Noise for Medical Image Classification

2024-06-18 · Zehui Liao, Shishuai Hu, Yanning Zhang, Yong Xia

Addressing mixed closed-set and open-set label noise in medical image classification remains a largely unexplored challenge. Unlike natural image classification, which often separates and processes closed-set and open-se…

Classificationimage-classificationImage ClassificationMedical Image Classification

Imprecise Label Learning: A Unified Framework for Learning with Various Imprecise Label Configurations

2023-05-22 · Hao Chen, Ankit Shah, Jindong Wang, Ran Tao 외

Learning with reduced labeling standards, such as noisy label, partial label, and multiple label candidates, which we generically refer to as \textit{imprecise} labels, is a commonplace challenge in machine learning task…

Learning with noisy labelsPartial Label Learning

DyGen: Learning from Noisy Labels via Dynamics-Enhanced Generative Modeling

2023-05-30 · Yuchen Zhuang, Yue Yu, Lingkai Kong, Xiang Chen 외

Learning from noisy labels is a challenge that arises in many real-world applications where training data can contain incorrect or corrupted labels. When fine-tuning language models with noisy labels, models can easily o…

Denoising