Similarity Comparisons for Interactive Fine-Grained Categorization
Current human-in-the-loop fine-grained visual categorization systems depend on a predefined vocabulary of attributes and parts, usually determined by experts. In this work, we move away from that expert-driven and attribute-centric paradigm and present a novel interactive classification system that incorporates computer vision and perceptual similarity metrics in a unified framework. At test time, users are asked to judge relative similarity between a query image and various sets of images; these general queries do not require expert-defined terminology and are applicable to other domains and basic-level categories, enabling a flexible, efficient, and scalable system for fine-grained categorization with humans in the loop. Our system outperforms existing state-of-the-art systems for relevance feedback-based image retrieval as well as interactive classification, resulting in a reduction of up to 43% in the average number of questions needed to correctly classify an image.
Code (0)
등록된 구현이 없습니다.
Tasks
AttributeFine-Grained Visual CategorizationGeneral ClassificationImage RetrievalRetrievalSimilar Papers 제목 키워드 기반
When Polysemy Matters: Modeling Semantic Categorization with Word Embeddings
Recent work using word embeddings to model semantic categorization have indicated that static models outperform the more recent contextual class of models (Majewska et al, 2021). In this paper, we consider polysemy as a …
Word EmbeddingsA Compositional Feature Embedding and Similarity Metric for Ultra-Fine-Grained Visual Categorization
Fine-grained visual categorization (FGVC), which aims at classifying objects with small inter-class variances, has been significantly advanced in recent years. However, ultra-fine-grained visual categorization (ultra-FGV…
Fine-Grained Visual CategorizationFGDCC: Fine-Grained Deep Cluster Categorization -- A Framework for Intra-Class Variability Problems in Plant Classification
Intra-class variability is given according to the significance in the degree of dissimilarity between images within a class. In that sense, depending on its intensity, intra-class variability can hinder the learning proc…
A Two-Layer Local Constrained Sparse Coding Method for Fine-Grained Visual Categorization
Fine-grained categories are more difficulty distinguished than generic categories due to the similarity of inter-class and the diversity of intra-class. Therefore, the fine-grained visual categorization (FGVC) is conside…
DiversityFine-Grained Visual CategorizationFine-grained Event Categorization with Heterogeneous Graph Convolutional Networks
Events are happening in real-world and real-time, which can be planned and organized occasions involving multiple people and objects. Social media platforms publish a lot of text messages containing public events with co…
ClusteringEvent Detection