MAC: A Benchmark for Multiple Attributes Compositional Zero-Shot Learning

2024-06-18 · Shuo Xu, Sai Wang, Xinyue Hu, Yutian Lin, Bo Du, Yu Wu

Compositional Zero-Shot Learning (CZSL) aims to learn semantic primitives (attributes and objects) from seen compositions and recognize unseen attribute-object compositions. Existing CZSL datasets focus on single attributes, neglecting the fact that objects naturally exhibit multiple interrelated attributes. Real-world objects often possess multiple interrelated attributes, and current datasets' narrow attribute scope and single attribute labeling introduce annotation biases, undermining model performance and evaluation. To address these limitations, we introduce the Multi-Attribute Composition (MAC) dataset, encompassing 18,217 images and 11,067 compositions with comprehensive, representative, and diverse attribute annotations. MAC includes an average of 30.2 attributes per object and 65.4 objects per attribute, facilitating better multi-attribute composition predictions. Our dataset supports deeper semantic understanding and higher-order attribute associations, providing a more realistic and challenging benchmark for the CZSL task. We also develop solutions for multi-attribute compositional learning and propose the MM-encoder to disentangling the attributes and objects.

📄 PDF Abstract BibTeX arXiv:2406.12757

Code (0)

등록된 구현이 없습니다.

Tasks

AttributeCompositional Zero-Shot Learning Zero-Shot Learning

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Learning to Compose Soft Prompts for Compositional Zero-Shot Learning

2022-04-07 · Nihal V. Nayak, Peilin Yu, Stephen H. Bach

We introduce compositional soft prompting (CSP), a parameter-efficient learning technique to improve the zero-shot compositionality of large-scale pretrained vision-language models (VLMs) like CLIP. We develop CSP for co…

Attribute Compositional Zero-Shot Learning Object Zero-Shot Learning

Learning Conditional Attributes for Compositional Zero-Shot Learning

2023-05-29 · CVPR 2023 1 · Qingsheng Wang, Lingqiao Liu, Chenchen Jing, Hao Chen 외

Compositional Zero-Shot Learning (CZSL) aims to train models to recognize novel compositional concepts based on learned concepts such as attribute-object combinations. One of the challenges is to model attributes interac…

Attribute Compositional Zero-Shot Learning Zero-Shot Learning

Zero-Shot Policy Transfer with Disentangled Task Representation of Meta-Reinforcement Learning

2022-10-01 · Zheng Wu, Yichen Xie, Wenzhao Lian, Changhao Wang 외

Humans are capable of abstracting various tasks as different combinations of multiple attributes. This perspective of compositionality is vital for human rapid learning and adaption since previous experiences from relate…

Disentanglement Meta Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)

Beyond Seen Primitive Concepts and Attribute-Object Compositional Learning

2024-01-01 · CVPR 2024 1 · Nirat Saini, Khoi Pham, Abhinav Shrivastava

Learning from seen attribute-object pairs to generalize to unseen compositions has been studied extensively in Compositional Zero-Shot Learning (CZSL). However CZSL setup is still limited to seen attributes and objec…

Attribute Compositional Zero-Shot Learning Zero-Shot Learning

Cross-composition Feature Disentanglement for Compositional Zero-shot Learning

2024-08-19 · Yuxia Geng, Runkai Zhu, Jiaoyan Chen, Jintai Chen 외

Disentanglement of visual features of primitives (i.e., attributes and objects) has shown exceptional results in Compositional Zero-shot Learning (CZSL). However, due to the feature divergence of an attribute (resp. obje…

Attribute Compositional Zero-Shot Learning Disentanglement Language Modeling+2