Deep Contextual Attention for Human-Object Interaction Detection
Human-object interaction detection is an important and relatively new class of visual relationship detection tasks, essential for deeper scene understanding. Most existing approaches decompose the problem into object localization and interaction recognition. Despite showing progress, these approaches only rely on the appearances of humans and objects and overlook the available context information, crucial for capturing subtle interactions between them. We propose a contextual attention framework for human-object interaction detection. Our approach leverages context by learning contextually-aware appearance features for human and object instances. The proposed attention module then adaptively selects relevant instance-centric context information to highlight image regions likely to contain human-object interactions. Experiments are performed on three benchmarks: V-COCO, HICO-DET and HCVRD. Our approach outperforms the state-of-the-art on all datasets. On the V-COCO dataset, our method achieves a relative gain of 4.4% in terms of role mean average precision ($mAP_{role}$), compared to the existing best approach.
Code (0)
등록된 구현이 없습니다.
Tasks
Human-Object Interaction DetectionObjectObject LocalizationRelationship DetectionScene UnderstandingVisual Relationship DetectionSimilar Papers 제목 키워드 기반
Visual-Semantic Graph Attention Networks for Human-Object Interaction Detection
In scene understanding, robotics benefit from not only detecting individual scene instances but also from learning their possible interactions. Human-Object Interaction (HOI) Detection infers the action predicate on a <h…
Graph AttentionHuman-Object Interaction DetectionObjectScene Understanding+1Learning Human-Object Interaction as Groups
Human-Object Interaction Detection (HOI-DET) aims to localize human-object pairs and identify their interactive relationships. To aggregate contextual cues, existing methods typically propagate information across all det…
Human-Object Interaction DetectionSemantic SimilarityContextualized Representation Learning for Effective Human-Object Interaction Detection
Human-Object Interaction (HOI) detection aims to simultaneously localize human-object pairs and recognize their interactions. While recent two-stage approaches have made significant progress, they still face challenges d…
Human-Object Interaction DetectionRepresentation LearningGTNet:Guided Transformer Network for Detecting Human-Object Interactions
The human-object interaction (HOI) detection task refers to localizing humans, localizing objects, and predicting the interactions between each human-object pair. HOI is considered one of the fundamental steps in truly u…
Human-Object Interaction DetectionObjectQPIC: Query-Based Pairwise Human-Object Interaction Detection with Image-Wide Contextual Information
We propose a simple, intuitive yet powerful method for human-object interaction (HOI) detection. HOIs are so diverse in spatial distribution in an image that existing CNN-based methods face the following three major draw…
Human-Object Interaction Concept DiscoveryHuman-Object Interaction Detection