Rb-PaStaNet: A Few-Shot Human-Object Interaction Detection Based on Rules and Part States
Existing Human-Object Interaction (HOI) Detection approaches have achieved great progress on nonrare classes while rare HOI classes are still not well-detected. In this paper, we intend to apply human prior knowledge into the existing work. So we add human-labeled rules to PaStaNet and propose Rb-PaStaNet aimed at improving rare HOI classes detection. Our results show a certain improvement of the rare classes, while the non-rare classes and the overall improvement is more considerable.
Code (1)
Tasks
Human-Object Interaction DetectionSimilar Papers 제목 키워드 기반
PaStaNet: Toward Human Activity Knowledge Engine
Existing image-based activity understanding methods mainly adopt direct mapping, i.e. from image to activity concepts, which may encounter performance bottleneck since the huge gap. In light of this, we propose a new pat…
Action DetectionHuman-Object Interaction DetectionTransfer LearningTransferable Interactiveness Knowledge for Human-Object Interaction Detection
Human-Object Interaction (HOI) detection is an important problem to understand how humans interact with objects. In this paper, we explore interactiveness knowledge which indicates whether a human and an object interact …
Human-Object Interaction DetectionObjectLocality-Aware Zero-Shot Human-Object Interaction Detection
Recent methods for zero-shot Human-Object Interaction (HOI) detection typically leverage the generalization ability of large Vision-Language Model (VLM), i.e., CLIP, on unseen categories, showing impressive results on va…
Human-Object Interaction DetectionObjectZero-Shot Human-Object Interaction DetectionBoosting Zero-Shot Human-Object Interaction Detection with Vision-Language Transfer
Human-Object Interaction (HOI) detection is a crucial task that involves localizing interactive human-object pairs and identifying the actions being performed. Most existing HOI detectors are supervised in nature and lac…
Human-Object Interaction DetectionLanguage ModelingLanguage ModellingObject+1Zero-shot HOI Detection with MLLM-based Detector-agnostic Interaction Recognition
Zero-shot Human-object interaction (HOI) detection aims to locate humans and objects in images and recognize their interactions. While advances in open-vocabulary object detection provide promising solutions for object l…
Visual Question AnsweringObject LocalizationObject Detection