A Skeleton-aware Graph Convolutional Network for Human-Object Interaction Detection
Detecting human-object interactions is essential for comprehensive understanding of visual scenes. In particular, spatial connections between humans and objects are important cues for reasoning interactions. To this end, we propose a skeleton-aware graph convolutional network for human-object interaction detection, named SGCN4HOI. Our network exploits the spatial connections between human keypoints and object keypoints to capture their fine-grained structural interactions via graph convolutions. It fuses such geometric features with visual features and spatial configuration features obtained from human-object pairs. Furthermore, to better preserve the object structural information and facilitate human-object interaction detection, we propose a novel skeleton-based object keypoints representation. The performance of SGCN4HOI is evaluated in the public benchmark V-COCO dataset. Experimental results show that the proposed approach outperforms the state-of-the-art pose-based models and achieves competitive performance against other models.
Code (1)
Tasks
Human-Object Interaction DetectionObjectSimilar Papers 제목 키워드 기반
A Topology-Aware Graph Convolutional Network for Human Pose Similarity and Action Quality Assessment
Action Quality Assessment (AQA) requires fine-grained understanding of human motion and precise evaluation of pose similarity. This paper proposes a topology-aware Graph Convolutional Network (GCN) framework, termed GCN-…
Action Quality AssessmentSkeleton-based Action Recognition of People Handling Objects
In visual surveillance systems, it is necessary to recognize the behavior of people handling objects such as a phone, a cup, or a plastic bag. In this paper, to address this problem, we propose a new framework for recogn…
Action RecognitionObjectPose EstimationSkeleton Based Action Recognition+13D Human Pose Estimation via Spatial Graph Order Attention and Temporal Body Aware Transformer
Nowadays, Transformers and Graph Convolutional Networks (GCNs) are the prevailing techniques for 3D human pose estimation. However, Transformer-based methods either ignore the spatial neighborhood relationships between t…
3D Human Pose EstimationPose EstimationContext Aware Graph Convolution for Skeleton-Based Action Recognition
Graph convolutional models have gained impressive successes on skeleton based human action recognition task. As graph convolution is a local operation, it cannot fully investigate non-local joints that could be vital to …
Action RecognitionSkeleton Based Action RecognitionTemporal Action LocalizationImproving Skeleton-based Action Recognition with Interactive Object Information
Human skeleton information is important in skeleton-based action recognition, which provides a simple and efficient way to describe human pose. However, existing skeleton-based methods focus more on the skeleton, ignorin…
Action RecognitionData Augmentationgraph constructionObject+1