paper-with-me

홈 › Papers

Focus-Consistent Multi-Level Aggregation for Compositional Zero-Shot Learning

2024-08-30 · Fengyuan Dai, Siteng Huang, Min Zhang, Biao Gong, Donglin Wang

To transfer knowledge from seen attribute-object compositions to recognize unseen ones, recent compositional zero-shot learning (CZSL) methods mainly discuss the optimal classification branches to identify the elements, leading to the popularity of employing a three-branch architecture. However, these methods mix up the underlying relationship among the branches, in the aspect of consistency and diversity. Specifically, consistently providing the highest-level features for all three branches increases the difficulty in distinguishing classes that are superficially similar. Furthermore, a single branch may focus on suboptimal regions when spatial messages are not shared between the personalized branches. Recognizing these issues and endeavoring to address them, we propose a novel method called Focus-Consistent Multi-Level Aggregation (FOMA). Our method incorporates a Multi-Level Feature Aggregation (MFA) module to generate personalized features for each branch based on the image content. Additionally, a Focus-Consistent Constraint encourages a consistent focus on the informative regions, thereby implicitly exchanging spatial information between all branches. Extensive experiments on three benchmark datasets (UT-Zappos, C-GQA, and Clothing16K) demonstrate that our FOMA outperforms SOTA.

📄 PDF Abstract BibTeX arXiv:2408.17083

Code (0)

등록된 구현이 없습니다.

Tasks

AttributeCompositional Zero-Shot LearningDiversityZero-Shot Learning

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Fine-Grained Image-Text Correspondence with Cost Aggregation for Open-Vocabulary Part Segmentation

2025-01-16 · CVPR 2025 1 · Jiho Choi, Seonho Lee, Minhyun Lee, Seungho Lee 외

Open-Vocabulary Part Segmentation (OVPS) is an emerging field for recognizing fine-grained parts in unseen categories. We identify two primary challenges in OVPS: (1) the difficulty in aligning part-level image-text corr…

Open Vocabulary Semantic SegmentationOpen-Vocabulary Semantic Segmentation

Align and Aggregate: Compositional Reasoning with Video Alignment and Answer Aggregation for Video Question-Answering

2024-07-03 · CVPR 2024 1 · Zhaohe Liao, Jiangtong Li, Li Niu, Liqing Zhang

Despite the recent progress made in Video Question-Answering (VideoQA), these methods typically function as black-boxes, making it difficult to understand their reasoning processes and perform consistent compositional re…

Contrastive LearningLanguage ModellingLarge Language ModelQuestion Answering+2

Consistency of Compositional Generalization across Multiple Levels

2024-12-18 · Chuanhao Li, Zhen Li, Chenchen Jing, Xiaomeng Fan 외

Compositional generalization is the capability of a model to understand novel compositions composed of seen concepts. There are multiple levels of novel compositions including phrase-phrase level, phrase-word level, and …

Meta-LearningQuestion AnsweringVideo GroundingVisual Question Answering

Compositional Text-to-Image Generation Via Region-aware Bimodal Direct Preference Optimization

2026-05-27 · Zhuohan Liu, Wujian Peng, Yitong Chen, Zuxuan Wu arxiv

Despite the rapid progress of text-to-image (T2I) models, generating images that accurately reflect complex compositional prompts (covering attribute bindings, object relationships, counting) still remains challenging. T…

Text-to-Image Generation

COVR: A test-bed for Visually Grounded Compositional Generalization with real images

2021-09-22 · EMNLP 2021 11 · Ben Bogin, Shivanshu Gupta, Matt Gardner, Jonathan Berant

While interest in models that generalize at test time to new compositions has risen in recent years, benchmarks in the visually-grounded domain have thus far been restricted to synthetic images. In this work, we propose …