paper-with-me

Papers

Learning Prototype Classifiers for Long-Tailed Recognition

2023-02-01 · Saurabh Sharma, Yongqin Xian, Ning Yu, Ambuj Singh

The problem of long-tailed recognition (LTR) has received attention in recent years due to the fundamental power-law distribution of objects in the real-world. Most recent works in LTR use softmax classifiers that are biased in that they correlate classifier norm with the amount of training data for a given class. In this work, we show that learning prototype classifiers addresses the biased softmax problem in LTR. Prototype classifiers can deliver promising results simply using Nearest-Class- Mean (NCM), a special case where prototypes are empirical centroids. We go one step further and propose to jointly learn prototypes by using distances to prototypes in representation space as the logit scores for classification. Further, we theoretically analyze the properties of Euclidean distance based prototype classifiers that lead to stable gradient-based optimization which is robust to outliers. To enable independent distance scales along each channel, we enhance Prototype classifiers by learning channel-dependent temperature parameters. Our analysis shows that prototypes learned by Prototype classifiers are better separated than empirical centroids. Results on four LTR benchmarks show that Prototype classifier outperforms or is comparable to state-of-the-art methods. Our code is made available at https://github.com/saurabhsharma1993/prototype-classifier-ltr.

📄 PDF Abstract BibTeX arXiv:2302.00491

Code (1)

saurabhsharma1993/prototype-classifier-ltr 공식 구현 pytorch

Tasks

Long-tail Learning

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

Inflated Episodic Memory With Region Self-Attention for Long-Tailed Visual Recognition

2020-06-01 · CVPR 2020 6 · Linchao Zhu, Yi Yang

There have been increasing interests in modeling long-tailed data. Unlike artificially collected datasets, long-tailed data are naturally existed in the real-world and thus more realistic. To deal with the class imbalanc…

Few-Shot LearningLong-tail LearningVideo Recognition

SuperDisco: Super-Class Discovery Improves Visual Recognition for the Long-Tail

2023-03-31 · CVPR 2023 1 · Yingjun Du, Jiayi Shen, XianTong Zhen, Cees G. M. Snoek

Modern image classifiers perform well on populated classes, while degrading considerably on tail classes with only a few instances. Humans, by contrast, effortlessly handle the long-tailed recognition challenge, since th…

Representation LearningSemantic SimilaritySemantic Textual Similarity

Uniformly Distributed Category Prototype-Guided Vision-Language Framework for Long-Tail Recognition

2023-08-24 · Siming Fu, Xiaoxuan He, Xinpeng Ding, Yuchen Cao 외

Recently, large-scale pre-trained vision-language models have presented benefits for alleviating class imbalance in long-tailed recognition. However, the long-tailed data distribution can corrupt the representation space…

AttributeImage-text matchingText Matching

Balanced Meta-Softmax for Long-Tailed Visual Recognition

2020-07-21 · NeurIPS 2020 12 · Jiawei Ren, Cunjun Yu, Shunan Sheng, Xiao Ma 외

Deep classifiers have achieved great success in visual recognition. However, real-world data is long-tailed by nature, leading to the mismatch between training and testing distributions. In this paper, we show that the S…

General ClassificationInstance SegmentationLong-tail LearningSemantic Segmentation

Comprehensive Multi-Modal Prototypes are Simple and Effective Classifiers for Vast-Vocabulary Object Detection

2024-12-23 · Yitong Chen, Wenhao Yao, Lingchen Meng, Sihong Wu 외

Enabling models to recognize vast open-world categories has been a longstanding pursuit in object detection. By leveraging the generalization capabilities of vision-language models, current open-world detectors can recog…

object-detectionObject DetectionObject RecognitionOpen-vocabulary object detection+1