Open World Compositional Zero-Shot Learning
Compositional Zero-Shot learning (CZSL) requires to recognize state-object compositions unseen during training. In this work, instead of assuming prior knowledge about the unseen compositions, we operate in the open world setting, where the search space includes a large number of unseen compositions some of which might be unfeasible. In this setting, we start from the cosine similarity between visual features and compositional embeddings. After estimating the feasibility score of each composition, we use these scores to either directly mask the output space or as a margin for the cosine similarity between visual features and compositional embeddings during training. Our experiments on two standard CZSL benchmarks show that all the methods suffer severe performance degradation when applied in the open world setting. While our simple CZSL model achieves state-of-the-art performances in the closed world scenario, our feasibility scores boost the performance of our approach in the open world setting, clearly outperforming the previous state of the art.
Code (2)
Tasks
Compositional Zero-Shot LearningZero-Shot LearningSimilar Papers 제목 키워드 기반
Compositional Zero-Shot Learning: A Survey
Compositional Zero-Shot Learning (CZSL) is a critical task in computer vision that enables models to recognize unseen combinations of known attributes and objects during inference, addressing the combinatorial challenge …
Compositional Zero-Shot LearningOn Leveraging Variational Graph Embeddings for Open World Compositional Zero-Shot Learning
Humans are able to identify and categorize novel compositions of known concepts. The task in Compositional Zero-Shot learning (CZSL) is to learn composition of primitive concepts, i.e. objects and states, in such a way t…
Compositional Zero-Shot LearningImage RetrievalMetric LearningRetrieval+1Attention Based Simple Primitives for Open World Compositional Zero-Shot Learning
Compositional Zero-Shot Learning (CZSL) aims to predict unknown compositions made up of attribute and object pairs. Predicting compositions unseen during training is a challenging task. We are exploring Open World Compos…
AttributeCompositional Zero-Shot LearningObjectZero-Shot LearningLearning Graph Embeddings for Open World Compositional Zero-Shot Learning
Compositional Zero-Shot learning (CZSL) aims to recognize unseen compositions of state and object visual primitives seen during training. A problem with standard CZSL is the assumption of knowing which unseen composition…
Compositional Zero-Shot LearningZero-Shot LearningLearning by Imagining: Debiased Feature Augmentation for Compositional Zero-Shot Learning
Compositional Zero-Shot Learning (CZSL) aims to recognize unseen attribute-object compositions by learning prior knowledge of seen primitives, \textit{i.e.}, attributes and objects. Learning generalizable compositional r…
Compositional Zero-Shot Learning