BLP -- Boundary Likelihood Pinpointing Networks for Accurate Temporal Action Localization
Despite tremendous progress achieved in temporal action detection, state-of-the-art methods still suffer from the sharp performance deterioration when localizing the starting and ending temporal action boundaries. Although most methods apply boundary regression paradigm to tackle this problem, we argue that the direct regression lacks detailed enough information to yield accurate temporal boundaries. In this paper, we propose a novel Boundary Likelihood Pinpointing (BLP) network to alleviate this deficiency of boundary regression and improve the localization accuracy. Given a loosely localized search interval that contains an action instance, BLP casts the problem of localizing temporal boundaries as that of assigning probabilities on each equally divided unit of this interval. These generated probabilities provide useful information regarding the boundary location of the action inside this search interval. Based on these probabilities, we introduce a boundary pinpointing paradigm to pinpoint the accurate boundaries under a simple probabilistic framework. Compared with other C3D feature based detectors, extensive experiments demonstrate that BLP significantly improves the localization performance of recent state-of-the-art detectors, and achieves competitive detection mAP on both THUMOS' 14 and ActivityNet datasets, particularly when the evaluation tIoU is high.
Code (0)
등록된 구현이 없습니다.
Tasks
Action DetectionAction LocalizationregressionTemporal Action LocalizationSimilar Papers 제목 키워드 기반
Anchor-free temporal action localization via Progressive Boundary-aware Boosting
Enormous untrimmed videos from the real world are difficult to analyze and manage. Temporal action localization algorithms can help us to locate and recognize human activity clips in untrimmed videos. Recently, anchor-fr…
Action LocalizationTemporal Action LocalizationTemporal Context Aggregation Network for Temporal Action Proposal Refinement
Temporal action proposal generation aims to estimate temporal intervals of actions in untrimmed videos, which is a challenging yet important task in the video understanding field. The proposals generated by current metho…
Action DetectionAction LocalizationRetrievalTemporal Action Localization+2CMSN: Continuous Multi-stage Network and Variable Margin Cosine Loss for Temporal Action Proposal Generation
Accurately locating the start and end time of an action in untrimmed videos is a challenging task. One of the important reasons is the boundary of action is not highly distinguishable, and the features around the boundar…
Temporal Action Proposal GenerationBoundary-Aware Proposal Generation Method for Temporal Action Localization
The goal of Temporal Action Localization (TAL) is to find the categories and temporal boundaries of actions in an untrimmed video. Most TAL methods rely heavily on action recognition models that are sensitive to action l…
Action LocalizationAction RecognitionContrastive LearningTemporal Action LocalizationLearning Salient Boundary Feature for Anchor-free Temporal Action Localization
Temporal action localization is an important yet challenging task in video understanding. Typically, such a task aims at inferring both the action category and localization of the start and end frame for each action inst…
Action LocalizationTemporal Action LocalizationTemporal LocalizationVideo Understanding