paper-with-me

홈 › Papers

Disentangled Feature Representation for Few-shot Image Classification

2021-09-26 · Hao Cheng, YuFei Wang, Haoliang Li, Alex C. Kot, Bihan Wen

Learning the generalizable feature representation is critical for few-shot image classification. While recent works exploited task-specific feature embedding using meta-tasks for few-shot learning, they are limited in many challenging tasks as being distracted by the excursive features such as the background, domain and style of the image samples. In this work, we propose a novel Disentangled Feature Representation framework, dubbed DFR, for few-shot learning applications. DFR can adaptively decouple the discriminative features that are modeled by the classification branch, from the class-irrelevant component of the variation branch. In general, most of the popular deep few-shot learning methods can be plugged in as the classification branch, thus DFR can boost their performance on various few-shot tasks. Furthermore, we propose a novel FS-DomainNet dataset based on DomainNet, for benchmarking the few-shot domain generalization tasks. We conducted extensive experiments to evaluate the proposed DFR on general and fine-grained few-shot classification, as well as few-shot domain generalization, using the corresponding four benchmarks, i.e., mini-ImageNet, tiered-ImageNet, CUB, as well as the proposed FS-DomainNet. Thanks to the effective feature disentangling, the DFR-based few-shot classifiers achieved the state-of-the-art results on all datasets.

📄 PDF Abstract BibTeX arXiv:2109.12548

Code (1)

chengcv/dfrfs 공식 구현 pytorch

Tasks

BenchmarkingClassificationDomain GeneralizationFew-Shot Image ClassificationFew-Shot Learningimage-classificationImage Classification

Similar Papers 제목 키워드 기반

Disentangling Semantic-to-visual Confusion for Zero-shot Learning

2021-06-16 · Zihan Ye, Fuyuan Hu, Fan Lyu, Linyan Li 외

Using generative models to synthesize visual features from semantic distribution is one of the most popular solutions to ZSL image classification in recent years. The triplet loss (TL) is popularly used to generate reali…

Generative Adversarial Networkimage-classificationImage ClassificationTriplet+1

Disentangling Representations through Multi-task Learning

2024-07-15 · Pantelis Vafidis, Aman Bhargava, Antonio Rangel

Intelligent perception and interaction with the world hinges on internal representations that capture its underlying structure (''disentangled'' or ''abstract'' representations). Disentangled representations serve as wor…

Decision MakingMulti-Task LearningZero-shot Generalization

Disentangled Ontology Embedding for Zero-shot Learning

2022-06-08 · Yuxia Geng, Jiaoyan Chen, Wen Zhang, Yajing Xu 외

Knowledge Graph (KG) and its variant of ontology have been widely used for knowledge representation, and have shown to be quite effective in augmenting Zero-shot Learning (ZSL). However, existing ZSL methods that utilize…

image-classificationImage ClassificationOntology EmbeddingZero-Shot Image Classification+1

Progressive Disentangled Representation Learning for Fine-Grained Controllable Talking Head Synthesis

2022-11-26 · CVPR 2023 1 · Duomin Wang, Yu Deng, Zixin Yin, Heung-Yeung Shum 외

We present a novel one-shot talking head synthesis method that achieves disentangled and fine-grained control over lip motion, eye gaze&blink, head pose, and emotional expression. We represent different motions via disen…

Contrastive LearningDisentanglementRepresentation Learning

Disentangling 3D Prototypical Networks For Few-Shot Concept Learning

2020-11-06 · ICLR 2021 1 · Mihir Prabhudesai, Shamit Lal, Darshan Patil, Hsiao-Yu Tung 외

We present neural architectures that disentangle RGB-D images into objects' shapes and styles and a map of the background scene, and explore their applications for few-shot 3D object detection and few-shot concept classi…

3D geometry3D Object DetectionObjectobject-detection+4