Precise Temporal Action Localization by Evolving Temporal Proposals
Locating actions in long untrimmed videos has been a challenging problem in video content analysis. The performances of existing action localization approaches remain unsatisfactory in precisely determining the beginning and the end of an action. Imitating the human perception procedure with observations and refinements, we propose a novel three-phase action localization framework. Our framework is embedded with an Actionness Network to generate initial proposals through frame-wise similarity grouping, and then a Refinement Network to conduct boundary adjustment on these proposals. Finally, the refined proposals are sent to a Localization Network for further fine-grained location regression. The whole process can be deemed as multi-stage refinement using a novel non-local pyramid feature under various temporal granularities. We evaluate our framework on THUMOS14 benchmark and obtain a significant improvement over the state-of-the-arts approaches. Specifically, the performance gain is remarkable under precise localization with high IoU thresholds. Our proposed framework achieves mAP@IoU=0.5 of 34.2%.
Code (0)
등록된 구현이 없습니다.
Tasks
Action LocalizationTemporal Action LocalizationSimilar Papers 제목 키워드 기반
Exploring Temporal Preservation Networks for Precise Temporal Action Localization
Temporal action localization is an important task of computer vision. Though a variety of methods have been proposed, it still remains an open question how to predict the temporal boundaries of action segments precisely.…
Action LocalizationOpen-Ended Question AnsweringTemporal Action LocalizationTemporal LocalizationExploring Frame Segmentation Networks for Temporal Action Localization
Temporal action localization is an important task of computer vision. Though many methods have been proposed, it still remains an open question how to predict the temporal location of action segments precisely. Most stat…
Action LocalizationOpen-Ended Question AnsweringTemporal Action LocalizationTemporally Precise Action Spotting in Soccer Videos Using Dense Detection Anchors
We present a model for temporally precise action spotting in videos, which uses a dense set of detection anchors, predicting a detection confidence and corresponding fine-grained temporal displacement for each anchor. We…
Action SpottingData AugmentationTemporal LocalizationProgress Regression RNN for Online Spatial-Temporal Action Localization in Unconstrained Videos
Previous spatial-temporal action localization methods commonly follow the pipeline of object detection to estimate bounding boxes and labels of actions. However, the temporal relation of an action has not been fully expl…
Action Localizationobject-detectionObject DetectionPosition+2Complementary Boundary Generator with Scale-Invariant Relation Modeling for Temporal Action Localization: Submission to ActivityNet Challenge 2020
This technical report presents an overview of our solution used in the submission to ActivityNet Challenge 2020 Task 1 (\textbf{temporal action localization/detection}). Temporal action localization requires to not only …
Action LocalizationDiversityTemporal Action Localization