paper-with-me

Papers

Decoupling Representation and Classifier for Long-Tailed Recognition

2019-10-21 · ICLR 2020 1 · Bingyi Kang, Saining Xie, Marcus Rohrbach, Zhicheng Yan, Albert Gordo, Jiashi Feng, Yannis Kalantidis

The long-tail distribution of the visual world poses great challenges for deep learning based classification models on how to handle the class imbalance problem. Existing solutions usually involve class-balancing strategies, e.g., by loss re-weighting, data re-sampling, or transfer learning from head- to tail-classes, but most of them adhere to the scheme of jointly learning representations and classifiers. In this work, we decouple the learning procedure into representation learning and classification, and systematically explore how different balancing strategies affect them for long-tailed recognition. The findings are surprising: (1) data imbalance might not be an issue in learning high-quality representations; (2) with representations learned with the simplest instance-balanced (natural) sampling, it is also possible to achieve strong long-tailed recognition ability by adjusting only the classifier. We conduct extensive experiments and set new state-of-the-art performance on common long-tailed benchmarks like ImageNet-LT, Places-LT and iNaturalist, showing that it is possible to outperform carefully designed losses, sampling strategies, even complex modules with memory, by using a straightforward approach that decouples representation and classification. Our code is available at https://github.com/facebookresearch/classifier-balancing.

📄 PDF Abstract BibTeX arXiv:1910.09217

Code (4)

facebookresearch/classifier-balancing 공식 구현 pytorch
PhilChina/classifier-balancing pytorch
jackhck/subclass-balancing-contrastive-learning pytorch
silicx/dlsa pytorch

Tasks

ClassificationGeneral ClassificationLong-tail LearningLong-tail learning with class descriptorsRepresentation LearningTransfer Learning

Similar Papers 제목 키워드 기반

Why Not Hyperparameter-Friendly Optimisation? A Monotonic Adaptive Norm Rescaling Approach For Long-Tailed Recognition

2026-06-01 · Shuo Zhang, Chenqi Li, Tingting Zhu arxiv

Long-tailed recognition poses a significant challenge for deep learning. The two-stage decoupling paradigm, which separates representation learning from classifier retraining, offers a promising solution. During the clas…

Representation Learning

Improving Calibration for Long-Tailed Recognition

2021-04-01 · CVPR 2021 1 · Zhisheng Zhong, Jiequan Cui, Shu Liu, Jiaya Jia

Deep neural networks may perform poorly when training datasets are heavily class-imbalanced. Recently, two-stage methods decouple representation learning and classifier learning to improve performance. But there is still…

Long-tail LearningRepresentation Learning

Decoupled Training for Long-Tailed Classification With Stochastic Representations

2023-04-19 · Giung Nam, Sunguk Jang, Juho Lee

Decoupling representation learning and classifier learning has been shown to be effective in classification with long-tailed data. There are two main ingredients in constructing a decoupled learning scheme; 1) how to tra…

ClassificationRepresentation Learning

Mix from Failure: Confusion-Pairing Mixup for Long-Tailed Recognition

2024-11-12 · Youngseok Yoon, Sangwoo Hong, Hyungjoon Joo, Yao Qin 외

Long-tailed image recognition is a computer vision problem considering a real-world class distribution rather than an artificial uniform. Existing methods typically detour the problem by i) adjusting a loss function, ii)…

Diversity

Class-Conditional Sharpness-Aware Minimization for Deep Long-Tailed Recognition

2023-01-01 · CVPR 2023 1 · Zhipeng Zhou, Lanqing Li, Peilin Zhao, Pheng-Ann Heng 외

It's widely acknowledged that deep learning models with flatter minima in its loss landscape tend to generalize better. However, such property is under-explored in deep long-tailed recognition (DLTR), a practical pro…

Long-tail Learning