Diagnosing Rarity in Human-Object Interaction Detection
Human-object interaction (HOI) detection is a core task in computer vision. The goal is to localize all human-object pairs and recognize their interactions. An interaction defined by a <verb, noun> tuple leads to a long-tailed visual recognition challenge since many combinations are rarely represented. The performance of the proposed models is limited especially for the tail categories, but little has been done to understand the reason. To that end, in this paper, we propose to diagnose rarity in HOI detection. We propose a three-step strategy, namely Detection, Identification and Recognition where we carefully analyse the limiting factors by studying state-of-the-art models. Our findings indicate that detection and identification steps are altered by the interaction signals like occlusion and relative location, as a result limiting the recognition accuracy.
Code (0)
등록된 구현이 없습니다.
Tasks
Human-Object Interaction DetectionObjectSimilar Papers 제목 키워드 기반
Diagnosing Human-object Interaction Detectors
We have witnessed significant progress in human-object interaction (HOI) detection. The reliance on mAP (mean Average Precision) scores as a summary metric, however, does not provide sufficient insight into the nuances o…
ClassificationHuman-Object Interaction DetectionObjectobject-detection+1Dictionary learning based image enhancement for rarity detection
Image enhancement is an important image processing technique that processes images suitably for a specific application e.g. image editing. The conventional solutions of image enhancement are grouped into two categories w…
Dictionary LearningImage EnhancementArgument Rarity-based Originality Assessment for AI-Assisted Writing
This study proposes Argument Rarity-based Originality Assessment (AROA), a framework for automatically evaluating argumentative originality in student essays. AROA defines originality as rarity within a reference corpus …
Density EstimationRarity-Gated Context Conditioning for Offline Imitation Learning-Based Maritime Anomaly Detection
Contextual anomaly detection aims to identify abnormal behavior conditional on context variables, but practical deployments often face highly imbalanced context distributions where rare regimes can be critical informatio…
Anomaly DetectionHODN: Disentangling Human-Object Feature for HOI Detection
The task of Human-Object Interaction (HOI) detection is to detect humans and their interactions with surrounding objects, where transformer-based methods show dominant advances currently. However, these methods ignore th…
DecoderHuman DetectionHuman-Object Interaction DetectionObject+2