Fine-grained Image Classification by Exploring Bipartite-Graph Labels
Given a food image, can a fine-grained object recognition engine tell "which restaurant which dish" the food belongs to? Such ultra-fine grained image recognition is the key for many applications like search by images, but it is very challenging because it needs to discern subtle difference between classes while dealing with the scarcity of training data. Fortunately, the ultra-fine granularity naturally brings rich relationships among object classes. This paper proposes a novel approach to exploit the rich relationships through bipartite-graph labels (BGL). We show how to model BGL in an overall convolutional neural networks and the resulting system can be optimized through back-propagation. We also show that it is computationally efficient in inference thanks to the bipartite structure. To facilitate the study, we construct a new food benchmark dataset, which consists of 37,885 food images collected from 6 restaurants and totally 975 menus. Experimental results on this new food and three other datasets demonstrates BGL advances previous works in fine-grained object recognition. An online demo is available at http://www.f-zhou.com/fg_demo/.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationFine-Grained Image ClassificationFine-Grained Image RecognitionGeneral Classificationimage-classificationImage ClassificationObjectObject RecognitionSimilar Papers 제목 키워드 기반
Exploring Vision Transformers for Fine-grained Classification
Existing computer vision research in categorization struggles with fine-grained attributes recognition due to the inherently high intra-class variances and low inter-class variances. SOTA methods tackle this challenge by…
ClassificationFine-Grained Image Classificationimage-classificationImage ClassificationFine-grained Entity Typing via Label Reasoning
Conventional entity typing approaches are based on independent classification paradigms, which make them difficult to recognize inter-dependent, long-tailed and fine-grained entity types. In this paper, we argue that the…
AttributeEntity TypingExploring Localization for Self-supervised Fine-grained Contrastive Learning
Self-supervised contrastive learning has demonstrated great potential in learning visual representations. Despite their success in various downstream tasks such as image classification and object detection, self-supervis…
Contrastive LearningFine-Grained Image ClassificationFine-Grained Image Recognitionimage-classification+2Exploring Fine-Grained Audiovisual Categorization with the SSW60 Dataset
We present a new benchmark dataset, Sapsucker Woods 60 (SSW60), for advancing research on audiovisual fine-grained categorization. While our community has made great strides in fine-grained visual categorization on image…
Fine-Grained Visual CategorizationVideo ClassificationMatchTIR: Fine-Grained Supervision for Tool-Integrated Reasoning via Bipartite Matching
Tool-Integrated Reasoning (TIR) empowers large language models (LLMs) to tackle complex tasks by interleaving reasoning steps with external tool interactions. However, existing reinforcement learning methods typically re…
Reinforcement Learning