Attention Based Simple Primitives for Open World Compositional Zero-Shot Learning
Compositional Zero-Shot Learning (CZSL) aims to predict unknown compositions made up of attribute and object pairs. Predicting compositions unseen during training is a challenging task. We are exploring Open World Compositional Zero-Shot Learning (OW-CZSL) in this study, where our test space encompasses all potential combinations of attributes and objects. Our approach involves utilizing the self-attention mechanism between attributes and objects to achieve better generalization from seen to unseen compositions. Utilizing a self-attention mechanism facilitates the model's ability to identify relationships between attribute and objects. The similarity between the self-attended textual and visual features is subsequently calculated to generate predictions during the inference phase. The potential test space may encompass implausible object-attribute combinations arising from unrestricted attribute-object pairings. To mitigate this issue, we leverage external knowledge from ConceptNet to restrict the test space to realistic compositions. Our proposed model, Attention-based Simple Primitives (ASP), demonstrates competitive performance, achieving results comparable to the state-of-the-art.
Code (1)
Tasks
AttributeCompositional Zero-Shot LearningObjectZero-Shot LearningSimilar Papers 제목 키워드 기반
Simple Primitives with Feasibility- and Contextuality-Dependence for Open-World Compositional Zero-shot Learning
The task of Compositional Zero-Shot Learning (CZSL) is to recognize images of novel state-object compositions that are absent during the training stage. Previous methods of learning compositional embedding have shown eff…
Compositional Zero-Shot LearningDisentanglementZero-Shot LearningProCC: Progressive Cross-primitive Compatibility for Open-World Compositional Zero-Shot Learning
Open-World Compositional Zero-shot Learning (OW-CZSL) aims to recognize novel compositions of state and object primitives in images with no priors on the compositional space, which induces a tremendously large output spa…
Compositional Zero-Shot LearningObjectZero-Shot LearningKG-SP: Knowledge Guided Simple Primitives for Open World Compositional Zero-Shot Learning
The goal of open-world compositional zero-shot learning (OW-CZSL) is to recognize compositions of state and objects in images, given only a subset of them during training and no prior on the unseen compositions. In this …
Compositional Zero-Shot LearningMissing LabelsZero-Shot LearningEVA: Mixture-of-Experts Semantic Variant Alignment for Compositional Zero-Shot Learning
Compositional Zero-Shot Learning (CZSL) investigates compositional generalization capacity to recognize unknown state-object pairs based on learned primitive concepts. Existing CZSL methods typically derive primitives fe…
Compositional Zero-Shot LearningMixture-of-ExpertsZero-Shot LearningPrimitive-Driven Compositional Forensic Visual Prompting for Open-World Face Anti-Spoofing
Open-world face anti-spoofing must address both covariate and semantic shifts: source and target domains differ in imaging conditions, while target domains contain diverse attack types absent from training. Existing prom…
Domain GeneralizationFace Anti-Spoofing