paper-with-me

홈 › Papers

Shaping Visual Representations with Attributes for Few-Shot Recognition

2021-12-13 · Haoxing Chen, Huaxiong Li, Yaohui Li, Chunlin Chen

Few-shot recognition aims to recognize novel categories under low-data regimes. Some recent few-shot recognition methods introduce auxiliary semantic modality, i.e., category attribute information, into representation learning, which enhances the feature discrimination and improves the recognition performance. Most of these existing methods only consider the attribute information of support set while ignoring the query set, resulting in a potential loss of performance. In this letter, we propose a novel attribute-shaped learning (ASL) framework, which can jointly perform query attributes generation and discriminative visual representation learning for few-shot recognition. Specifically, a visual-attribute predictor (VAP) is constructed to predict the attributes of queries. By leveraging the attributes information, an attribute-visual attention module (AVAM) is designed, which can adaptively utilize attributes and visual representations to learn more discriminative features. Under the guidance of attribute modality, our method can learn enhanced semantic-aware representation for classification. Experiments demonstrate that our method can achieve competitive results on CUB and SUN benchmarks. Our source code is available at: \url{https://github.com/chenhaoxing/ASL}.

📄 PDF Abstract BibTeX arXiv:2112.06398

Code (1)

chenhaoxing/ASL 공식 구현 pytorch

Tasks

AttributeFew-Shot LearningMetric LearningRepresentation Learning

Similar Papers 제목 키워드 기반

Zero-Shot Activity Recognition with Verb Attribute Induction

2017-07-29 · EMNLP 2017 9 · Rowan Zellers, Yejin Choi

In this paper, we investigate large-scale zero-shot activity recognition by modeling the visual and linguistic attributes of action verbs. For example, the verb "salute" has several properties, such as being a light move…

Activity RecognitionAttribute

Attributes-Guided and Pure-Visual Attention Alignment for Few-Shot Recognition

2020-09-10 · Siteng Huang, Min Zhang, Yachen Kang, Donglin Wang

The purpose of few-shot recognition is to recognize novel categories with a limited number of labeled examples in each class. To encourage learning from a supplementary view, recent approaches have introduced auxiliary s…

feature selectionMetric Learning

Learning Deep Representations of Fine-grained Visual Descriptions

2016-05-17 · CVPR 2016 6 · Scott Reed, Zeynep Akata, Bernt Schiele, Honglak Lee

State-of-the-art methods for zero-shot visual recognition formulate learning as a joint embedding problem of images and side information. In these formulations the current best complement to visual features are attribute…

AttributeImage RetrievalRetrievalzero-shot-classification+1

Alternative Semantic Representations for Zero-Shot Human Action Recognition

2017-06-28 · Qian Wang, Ke Chen

A proper semantic representation for encoding side information is key to the success of zero-shot learning. In this paper, we explore two alternative semantic representations especially for zero-shot human action recogni…

Action RecognitionTemporal Action LocalizationZero-Shot Action RecognitionZero-Shot Learning

Towards Zero-shot Sign Language Recognition

2022-01-15 · Yunus Can Bilge, Ramazan Gokberk Cinbis, Nazli Ikizler-Cinbis

This paper tackles the problem of zero-shot sign language recognition (ZSSLR), where the goal is to leverage models learned over the seen sign classes to recognize the instances of unseen sign classes. In this context, r…

AttributeDescriptiveSign Language RecognitionTransfer Learning+1