Category Query Learning for Human-Object Interaction Classification
Unlike most previous HOI methods that focus on learning better human-object features, we propose a novel and complementary approach called category query learning. Such queries are explicitly associated to interaction categories, converted to image specific category representation via a transformer decoder, and learnt via an auxiliary image-level classification task. This idea is motivated by an earlier multi-label image classification method, but is for the first time applied for the challenging human-object interaction classification task. Our method is simple, general and effective. It is validated on three representative HOI baselines and achieves new state-of-the-art results on two benchmarks.
Code (1)
Tasks
ClassificationDecoderHuman-Object Interaction Detectionimage-classificationImage ClassificationMulti-Label Image ClassificationObjectSimilar Papers 제목 키워드 기반
Category-Aware Transformer Network for Better Human-Object Interaction Detection
Human-Object Interactions (HOI) detection, which aims to localize a human and a relevant object while recognizing their interaction, is crucial for understanding a still image. Recently, transformer-based models have sig…
Human-Object Interaction DetectionObjectobject-detectionObject DetectionOrchestrating the Symphony of Prompt Distribution Learning for Human-Object Interaction Detection
Human-object interaction (HOI) detectors with popular query-transformer architecture have achieved promising performance. However, accurately identifying uncommon visual patterns and distinguishing between ambiguous HOIs…
Human-Object Interaction DetectionQueryCraft: Transformer-Guided Query Initialization for Enhanced Human-Object Interaction Detection
Human-Object Interaction (HOI) detection aims to localize human-object pairs and recognize their interactions in images. Although DETR-based methods have recently emerged as the mainstream framework for HOI detection, th…
Human-Object Interaction DetectionHORP: Human-Object Relation Priors Guided HOI Detection
Human-Object Interaction (HOI) detection aims to predict the <Human, Interaction, Object> triplets, where the core challenge lies in recognizing the interaction of each human-object pair. Despite recent progress than…
Human-Object Interaction DetectionObjectRelationRevisiting Human-in-the-Loop Object Retrieval with Pre-Trained Vision Transformers
Building on existing approaches, we revisit Human-in-the-Loop Object Retrieval, a task that consists of iteratively retrieving images containing objects of a class-of-interest, specified by a user-provided query. Startin…
Binary ClassificationActive Learning