Using Shape to Categorize: Low-Shot Learning with an Explicit Shape Bias
It is widely accepted that reasoning about object shape is important for object recognition. However, the most powerful object recognition methods today do not explicitly make use of object shape during learning. In this work, motivated by recent developments in low-shot learning, findings in developmental psychology, and the increased use of synthetic data in computer vision research, we investigate how reasoning about 3D shape can be used to improve low-shot learning methods' generalization performance. We propose a new way to improve existing low-shot learning approaches by learning a discriminative embedding space using 3D object shape, and using this embedding by learning how to map images into it. Our new approach improves the performance of image-only low-shot learning approaches on multiple datasets. We also introduce Toys4K, a 3D object dataset with the largest number of object categories currently available, which supports low-shot learning.
Code (1)
Tasks
ObjectObject RecognitionSimilar Papers 제목 키워드 기반
Assessing Shape Bias Property of Convolutional Neural Networks
It is known that humans display "shape bias" when classifying new items, i.e., they prefer to categorize objects based on their shape rather than color. Convolutional Neural Networks (CNNs) are also designed to take into…
One-Shot LearningCognitive Psychology for Deep Neural Networks: A Shape Bias Case Study
Deep neural networks (DNNs) have achieved unprecedented performance on a wide range of complex tasks, rapidly outpacing our understanding of the nature of their solutions. This has caused a recent surge of interest in me…
One-Shot LearningFew-shot Shape Recognition by Learning Deep Shape-aware Features
Traditional shape descriptors have been gradually replaced by convolutional neural networks due to their superior performance in feature extraction and classification. The state-of-the-art methods recognize object shapes…
Image ReconstructionVessShape: Few-shot 2D blood vessel segmentation by leveraging shape priors from synthetic images
Semantic segmentation of blood vessels is an important task in medical image analysis, but its progress is often hindered by the scarcity of large annotated datasets and the poor generalization of models across different…
Semantic SegmentationCIGMO: Categorical invariant representations in a deep generative framework
Data of general object images have two most common structures: (1) each object of a given shape can be rendered in multiple different views, and (2) shapes of objects can be categorized in such a way that the diversity o…
DisentanglementDiversityObjectWeakly-supervised Learning