SuperDisco: Super-Class Discovery Improves Visual Recognition for the Long-Tail
Modern image classifiers perform well on populated classes, while degrading considerably on tail classes with only a few instances. Humans, by contrast, effortlessly handle the long-tailed recognition challenge, since they can learn the tail representation based on different levels of semantic abstraction, making the learned tail features more discriminative. This phenomenon motivated us to propose SuperDisco, an algorithm that discovers super-class representations for long-tailed recognition using a graph model. We learn to construct the super-class graph to guide the representation learning to deal with long-tailed distributions. Through message passing on the super-class graph, image representations are rectified and refined by attending to the most relevant entities based on the semantic similarity among their super-classes. Moreover, we propose to meta-learn the super-class graph under the supervision of a prototype graph constructed from a small amount of imbalanced data. By doing so, we obtain a more robust super-class graph that further improves the long-tailed recognition performance. The consistent state-of-the-art experiments on the long-tailed CIFAR-100, ImageNet, Places and iNaturalist demonstrate the benefit of the discovered super-class graph for dealing with long-tailed distributions.
Code (0)
등록된 구현이 없습니다.
Tasks
Representation LearningSemantic SimilaritySemantic Textual SimilaritySimilar Papers 제목 키워드 기반
Learning Like Humans: Analogical Concept Learning for Generalized Category Discovery
Generalized Category Discovery (GCD) seeks to uncover novel categories in unlabeled data while preserving recognition of known categories, yet prevailing visual-only pipelines and the loose coupling between supervised le…
Transfer Learning via Unsupervised Task Discovery for Visual Question Answering
We study how to leverage off-the-shelf visual and linguistic data to cope with out-of-vocabulary answers in visual question answering task. Existing large-scale visual datasets with annotations such as image class labels…
Question AnsweringTransfer LearningVisual Question AnsweringVisual Question Answering (VQA)Unsupervised Discovery of Object-Centric Neural Fields
We study inferring 3D object-centric scene representations from a single image. While recent methods have shown potential in unsupervised 3D object discovery from simple synthetic images, they fail to generalize to real-…
ObjectObject DiscoverySemantic SegmentationSystematic Generalization+1Visual Discovery at Pinterest
Over the past three years Pinterest has experimented with several visual search and recommendation services, including Related Pins (2014), Similar Looks (2015), Flashlight (2016) and Lens (2017). This paper presents an …
object-detectionObject DetectionUnsupervised Place Discovery for Visual Place Classification
In this study, we explore the use of deep convolutional neural networks (DCNNs) in visual place classification for robotic mapping and localization. An open question is how to partition the robot's workspace into places …
ClassificationGeneral ClassificationOpen-Ended Question Answering