paper-with-me

Papers

Deep Contextual Attention for Human-Object Interaction Detection

2019-10-17 · ICCV 2019 10 · Tiancai Wang, Rao Muhammad Anwer, Muhammad Haris Khan, Fahad Shahbaz Khan, Yanwei Pang, Ling Shao, Jorma Laaksonen

Human-object interaction detection is an important and relatively new class of visual relationship detection tasks, essential for deeper scene understanding. Most existing approaches decompose the problem into object localization and interaction recognition. Despite showing progress, these approaches only rely on the appearances of humans and objects and overlook the available context information, crucial for capturing subtle interactions between them. We propose a contextual attention framework for human-object interaction detection. Our approach leverages context by learning contextually-aware appearance features for human and object instances. The proposed attention module then adaptively selects relevant instance-centric context information to highlight image regions likely to contain human-object interactions. Experiments are performed on three benchmarks: V-COCO, HICO-DET and HCVRD. Our approach outperforms the state-of-the-art on all datasets. On the V-COCO dataset, our method achieves a relative gain of 4.4% in terms of role mean average precision ($mAP_{role}$), compared to the existing best approach.

📄 PDF Abstract BibTeX arXiv:1910.07721

Code (0)

등록된 구현이 없습니다.

Tasks

Human-Object Interaction DetectionObjectObject LocalizationRelationship DetectionScene UnderstandingVisual Relationship Detection

Similar Papers 제목 키워드 기반

Visual-Semantic Graph Attention Networks for Human-Object Interaction Detection

2020-01-07 · Zhijun Liang, Juan Rojas, Junfa Liu, Yisheng Guan

In scene understanding, robotics benefit from not only detecting individual scene instances but also from learning their possible interactions. Human-Object Interaction (HOI) Detection infers the action predicate on a <h…

Graph AttentionHuman-Object Interaction DetectionObjectScene Understanding+1

Learning Human-Object Interaction as Groups

2025-10-21 · Jiajun Hong, Jianan Wei, Wenguan Wang arxiv

Human-Object Interaction Detection (HOI-DET) aims to localize human-object pairs and identify their interactive relationships. To aggregate contextual cues, existing methods typically propagate information across all det…

Human-Object Interaction DetectionSemantic Similarity

Contextualized Representation Learning for Effective Human-Object Interaction Detection

2025-09-16 · Zhehao Li, Yucheng Qian, Chong Wang, Yinghao Lu 외 arxiv

Human-Object Interaction (HOI) detection aims to simultaneously localize human-object pairs and recognize their interactions. While recent two-stage approaches have made significant progress, they still face challenges d…

Human-Object Interaction DetectionRepresentation Learning

GTNet:Guided Transformer Network for Detecting Human-Object Interactions

2021-08-02 · A S M Iftekhar, Satish Kumar, R. Austin McEver, Suya You 외

The human-object interaction (HOI) detection task refers to localizing humans, localizing objects, and predicting the interactions between each human-object pair. HOI is considered one of the fundamental steps in truly u…

Human-Object Interaction DetectionObject

QPIC: Query-Based Pairwise Human-Object Interaction Detection with Image-Wide Contextual Information

2021-03-09 · CVPR 2021 1 · Masato Tamura, Hiroki Ohashi, Tomoaki Yoshinaga

We propose a simple, intuitive yet powerful method for human-object interaction (HOI) detection. HOIs are so diverse in spatial distribution in an image that existing CNN-based methods face the following three major draw…

Human-Object Interaction Concept DiscoveryHuman-Object Interaction Detection