paper-with-me

홈 › Papers

Compositional Zero-Shot Learning via Fine-Grained Dense Feature Composition

2020-12-01 · NeurIPS 2020 12 · Dat Huynh, Ehsan Elhamifar

We develop a novel generative model for zero-shot learning to recognize fine-grained unseen classes without training samples. Our observation is that generating holistic features of unseen classes fails to capture every attribute needed to distinguish small differences among classes. We propose a feature composition framework that learns to extract attribute-based features from training samples and combines them to construct fine-grained features for unseen classes. Feature composition allows us to not only selectively compose features of unseen classes from only relevant training samples, but also obtain diversity among composed features via changing samples used for composition. In addition, instead of building a global feature of an unseen class, we use all attribute-based features to form a dense representation consisting of fine-grained attribute details. To recognize unseen classes, we propose a novel training scheme that uses a discriminative model to construct features that are subsequently used to train itself. Therefore, we directly train the discriminative model on composed features without learning separate generative models. We conduct experiments on four popular datasets of DeepFashion, AWA2, CUB, and SUN, showing that our method significantly improves the state of the art.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

AttributeCompositional Zero-Shot LearningDiversityZero-Shot Learning

Similar Papers 제목 키워드 기반

Compositional Fine-Grained Low-Shot Learning

2021-05-21 · Dat Huynh, Ehsan Elhamifar

We develop a novel compositional generative model for zero- and few-shot learning to recognize fine-grained classes with a few or no training samples. Our key observation is that generating holistic features for fine-gra…

AttributeDiversityFew-Shot LearningZero-Shot Learning

Compositional Text-to-Image Generation with Dense Blob Representations

2024-05-14 · Weili Nie, Sifei Liu, Morteza Mardani, Chao Liu 외

Existing text-to-image models struggle to follow complex text prompts, raising the need for extra grounding inputs for better controllability. In this work, we propose to decompose a scene into visual primitives - denote…

Image GenerationIn-Context LearningText to Image GenerationText-to-Image Generation

Exploring the Spectrum of Visio-Linguistic Compositionality and Recognition

2024-06-13 · Youngtaek Oh, Pyunghwan Ahn, Jinhyung Kim, Gwangmo Song 외

Vision and language models (VLMs) such as CLIP have showcased remarkable zero-shot recognition abilities yet face challenges in visio-linguistic compositionality, particularly in linguistic comprehension and fine-grained…

Retrievalzero-shot-classificationZero-Shot Learning

A causal view of compositional zero-shot recognition

2020-06-25 · NeurIPS 2020 12 · Yuval Atzmon, Felix Kreuk, Uri Shalit, Gal Chechik

People easily recognize new visual categories that are new combinations of known components. This compositional generalization capacity is critical for learning in real-world domains like vision and language because the …

AttributeCompositional Zero-Shot LearningZero-Shot Learning

Let's Split Up: Zero-Shot Classifier Edits for Fine-Grained Video Understanding

2026-02-18 · Kaiting Liu, Hazel Doughty arxiv

Video recognition models are typically trained on fixed taxonomies which are often too coarse, collapsing distinctions in object, manner or outcome under a single label. As tasks and definitions evolve, such models canno…