paper-with-me

홈 › Papers

Compositional Zero-Shot Learning with Contextualized Cues and Adaptive Contrastive Training

2024-12-10 · Yun Li, Zhe Liu, Lina Yao

Compositional Zero-Shot Learning (CZSL) aims to recognize unseen combinations of seen attributes and objects. Current CLIP-based methods in CZSL, despite their advancements, often fail to effectively understand and link the attributes and objects due to inherent limitations in CLIP's pretraining mechanisms. To address these shortcomings, this paper introduces a novel framework, Understanding and Linking Attributes and Objects (ULAO) in CZSL, which comprises two innovative modules. The Understanding Attributes and Objects (UAO) module improves primitive understanding by sequential primitive prediction and leveraging recognized objects as contextual hints for attribute classification. Concurrently, the Linking Attributes and Objects (LAO) module improves the attribute-object linkage understanding through a new contrastive learning strategy that incorporates tailored hard negative generation and adaptive loss adjustments. We demonstrate our model's superiority by showcasing its state-of-the-art performance across three benchmark datasets in both Closed-World (CW) and Open-World (OW) scenarios.

📄 PDF Abstract BibTeX arXiv:2412.07161

Code (0)

등록된 구현이 없습니다.

Tasks

AttributeCompositional Zero-Shot LearningContrastive LearningZero-Shot Learning

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음
Adaptive Loss 설명 없음

Similar Papers 제목 키워드 기반

Zero-Shot Compositional Concept Learning

2021-07-12 · ACL (MetaNLP) 2021 8 · Guangyue Xu, Parisa Kordjamshidi, Joyce Y. Chai

In this paper, we study the problem of recognizing compositional attribute-object concepts within the zero-shot learning (ZSL) framework. We propose an episode-based cross-attention (EpiCA) network which combines merits …

AttributeZero-Shot Learning

COBE: Contextualized Object Embeddings from Narrated Instructional Video

2020-07-14 · NeurIPS 2020 12 · Gedas Bertasius, Lorenzo Torresani

Many objects in the real world undergo dramatic variations in visual appearance. For example, a tomato may be red or green, sliced or chopped, fresh or fried, liquid or solid. Training a single detector to accurately rec…

Human-Object Interaction DetectionObjectobject-detectionObject Detection+1

Language Models as Zero-shot Visual Semantic Learners

2021-07-26 · Yue Jiao, Jonathon Hare, Adam Prügel-Bennett

Visual Semantic Embedding (VSE) models, which map images into a rich semantic embedding space, have been a milestone in object recognition and zero-shot learning. Current approaches to VSE heavily rely on static word em-…

ObjectObject RecognitionWord EmbeddingsZero-Shot Learning

Gate-and-Merge: Zero-shot Compositional Personalization of Vision Language Models

2026-05-09 · Guodong Ding, Angela Yao arxiv

This paper tackles compositional personalization of vision-language models (VLMs). In this problem, multiple user-defined concepts must be recognized or described jointly at test time. We introduce Gate-and-Merge, a zero…

Why Can't I Open My Drawer? Mitigating Object-Driven Shortcuts in Zero-Shot Compositional Action Recognition

2026-01-22 · Geo Ahn, Inwoong Lee, Taeoh Kim, Minho Shim 외 arxiv

Zero-Shot Compositional Action Recognition (ZS-CAR) requires recognizing novel verb-object combinations composed of previously observed primitives. In this work, we tackle a key failure mode: models predict verbs via obj…

Action Recognition