Progressive Boundary Refinement Network for Temporal Action Detection
Temporal action detection is a challenging task due to vagueness of action boundaries. To tackle this issue, we propose an end-to-end progressive boundary refinement network (PBRNet) in this paper. PBRNet belongs to the family of one-stage detectors and is equipped with three cascaded detection modules for localizing action boundary more and more precisely. Specifically, PBRNet mainly consists of coarse pyramidal detection, refined pyramidal detection, and fine-grained detection. The first two modules build two feature pyramids to perform the anchor-based detection, and the third one explores the frame-level features to refine the boundaries of each action instance. In the fined-grained detection module, three frame-level classification branches are proposed to augment the frame-level features and update the confidence scores of action instances. Evidently, PBRNet integrates the anchorbased and frame-level methods. We experimentally evaluate the proposed PBRNet and comprehensively investigate the effect of the main components. The results show PBRNet achieves the state-of-the-art detection performances on two popular benchmarks: THUMOS’14 and ActivityNet, and meanwhile possesses a high inference speed.
Code (0)
등록된 구현이 없습니다.
Tasks
Action DetectionSimilar Papers 제목 키워드 기반
Temporal Context Aggregation Network for Temporal Action Proposal Refinement
Temporal action proposal generation aims to estimate temporal intervals of actions in untrimmed videos, which is a challenging yet important task in the video understanding field. The proposals generated by current metho…
Action DetectionAction LocalizationRetrievalTemporal Action Localization+2Anchor-free temporal action localization via Progressive Boundary-aware Boosting
Enormous untrimmed videos from the real world are difficult to analyze and manage. Temporal action localization algorithms can help us to locate and recognize human activity clips in untrimmed videos. Recently, anchor-fr…
Action LocalizationTemporal Action LocalizationCascaded Boundary Regression for Temporal Action Detection
Temporal action detection in long videos is an important problem. State-of-the-art methods address this problem by applying action classifiers on sliding windows. Although sliding windows may contain an identifiable port…
Action DetectionregressionMambaRefine-CD: MambaVision with Region-Boundary Temporal Refinement
Binary change detection in remote sensing requires both complete changed-region localization and accurate boundary delineation. We present MambaRefine-CD, a region-boundary temporal refinement framework built on a shared…
Change DetectionBoundary-Aware Salient Object Detection via Recurrent Two-Stream Guided Refinement Network
Recent deep learning based salient object detection methods which utilize both saliency and boundary features have achieved remarkable performance. However, most of them ignore the complementarity between saliency featur…
object-detectionObject DetectionRGB Salient Object DetectionSalient Object Detection