Designing Category-Level Attributes for Discriminative Visual Recognition
Attribute-based representation has shown great promises for visual recognition due to its intuitive interpretation and cross-category generalization property. However, human efforts are usually involved in the attribute designing process, making the representation costly to obtain. In this paper, we propose a novel formulation to automatically design discriminative "category-level attributes", which can be efficiently encoded by a compact category-attribute matrix. The formulation allows us to achieve intuitive and critical design criteria (category-separability, learnability) in a principled way. The designed attributes can be used for tasks of cross-category knowledge transfer, achieving superior performance over well-known attribute dataset Animals with Attributes (AwA) and a large-scale ILSVRC2010 dataset (1.2M images). This approach also leads to state-ofthe-art performance on the zero-shot learning task on AwA.
Code (0)
등록된 구현이 없습니다.
Tasks
AttributeTransfer LearningZero-Shot LearningSimilar Papers 제목 키워드 기반
Category-specific Semantic Coherency Learning for Fine-grained Image Recognition
Existing deep learning based weakly supervised fine-grained image recognition (WFGIR) methods usually pick out the discriminative regions from the high-level feature (HLF) maps directly. However, as HLF maps are derived…
AttributeFine-Grained Image RecognitionMid-level Representation for Visual Recognition
Visual Recognition is one of the fundamental challenges in AI, where the goal is to understand the semantics of visual data. Employing mid-level representation, in particular, shifted the paradigm in visual recognition. …
object-detectionObject DetectionVideo UnderstandingA Unified Semantic Embedding: Relating Taxonomies and Attributes
We propose a method that learns a discriminative yet semantic space for object categorization, where we also embed auxiliary semantic entities such as supercategories and attributes. Contrary to prior work which only uti…
Object CategorizationShaping Visual Representations with Attributes for Few-Shot Recognition
Few-shot recognition aims to recognize novel categories under low-data regimes. Some recent few-shot recognition methods introduce auxiliary semantic modality, i.e., category attribute information, into representation le…
AttributeFew-Shot LearningMetric LearningRepresentation LearningSemantic-Aware Dual Contrastive Learning for Multi-label Image Classification
Extracting image semantics effectively and assigning corresponding labels to multiple objects or attributes for natural images is challenging due to the complex scene contents and confusing label dependencies. Recent wor…
Contrastive Learningimage-classificationImage ClassificationMulti-Label Image Classification+2