Learning to track for spatio-temporal action localization
We propose an effective approach for spatio-temporal action localization in realistic videos. The approach first detects proposals at the frame-level and scores them with a combination of static and motion CNN features. It then tracks high-scoring proposals throughout the video using a tracking-by-detection approach. Our tracker relies simultaneously on instance-level and class-level detectors. The tracks are scored using a spatio-temporal motion histogram, a descriptor at the track level, in combination with the CNN features. Finally, we perform temporal localization of the action using a sliding-window approach at the track level. We present experimental results for spatio-temporal localization on the UCF-Sports, J-HMDB and UCF-101 action localization datasets, where our approach outperforms the state of the art with a margin of 15%, 7% and 12% respectively in mAP.
Code (0)
등록된 구현이 없습니다.
Tasks
Action LocalizationSpatio-Temporal Action LocalizationTemporal Action LocalizationTemporal LocalizationSimilar Papers 제목 키워드 기반
Modeling Spatio-Temporal Human Track Structure for Action Localization
This paper addresses spatio-temporal localization of human actions in video. In order to localize actions in time, we propose a recurrent localization network (RecLNet) designed to model the temporal structure of actions…
Action LocalizationHuman DetectionOptical Flow EstimationSpatio-Temporal Action Localization+2Max-Margin Structured Output Regression for Spatio-Temporal Action Localization
Structured output learning has been successfully applied to object localization, where the mapping between an image and an object bounding box can be well captured. Its extension to action localization in videos, however…
Action LocalizationObject LocalizationregressionSpatio-Temporal Action Localization+1Temporal Adaptive RGBT Tracking with Modality Prompt
RGBT tracking has been widely used in various fields such as robotics, surveillance processing, and autonomous driving. Existing RGBT trackers fully explore the spatial information between the template and the search reg…
Autonomous DrivingRgb-T TrackingDetecting Parts for Action Localization
In this paper, we propose a new framework for action localization that tracks people in videos and extracts full-body human tubes, i.e., spatio-temporal regions localizing actions, even in the case of occlusions or trunc…
Action LocalizationHuman Action Localization with Sparse Spatial Supervision
We introduce an approach for spatio-temporal human action localization using sparse spatial supervision. Our method leverages the large amount of annotated humans available today and extracts human tubes by combining a s…
Action LocalizationDiversity