Fast Learning of Temporal Action Proposal via Dense Boundary Generator
Generating temporal action proposals remains a very challenging problem, where the main issue lies in predicting precise temporal proposal boundaries and reliable action confidence in long and untrimmed real-world videos. In this paper, we propose an efficient and unified framework to generate temporal action proposals named Dense Boundary Generator (DBG), which draws inspiration from boundary-sensitive methods and implements boundary classification and action completeness regression for densely distributed proposals. In particular, the DBG consists of two modules: Temporal boundary classification (TBC) and Action-aware completeness regression (ACR). The TBC aims to provide two temporal boundary confidence maps by low-level two-stream features, while the ACR is designed to generate an action completeness score map by high-level action-aware features. Moreover, we introduce a dual stream BaseNet (DSB) to encode RGB and optical flow information, which helps to capture discriminative boundary and actionness features. Extensive experiments on popular benchmarks ActivityNet-1.3 and THUMOS14 demonstrate the superiority of DBG over the state-of-the-art proposal generator (e.g., MGG and BMN). Our code will be made available upon publication.
Code (3)
Tasks
General ClassificationOptical Flow EstimationregressionTemporal Action LocalizationSimilar Papers 제목 키워드 기반
BMN: Boundary-Matching Network for Temporal Action Proposal Generation
Temporal action proposal generation is an challenging and promising task which aims to locate temporal regions in real-world videos where action or event may occur. Current bottom-up proposal generation methods can gener…
Action DetectionAction RecognitionTemporal Action LocalizationTemporal Action Proposal GenerationFaster Learning of Temporal Action Proposal via Sparse Multilevel Boundary Generator
Temporal action localization in videos presents significant challenges in the field of computer vision. While the boundary-sensitive method has been widely adopted, its limitations include incomplete use of intermediate …
Action LocalizationTemporal Action LocalizationDCAN: Improving Temporal Action Detection via Dual Context Aggregation
Temporal action detection aims to locate the boundaries of action in the video. The current method based on boundary matching enumerates and calculates all possible boundary matchings to generate proposals. However, thes…
Action DetectionTemporal Action LocalizationContext-aware Proposal Network for Temporal Action Detection
This technical report presents our first place winning solution for temporal action detection task in CVPR-2022 AcitivityNet Challenge. The task aims to localize temporal boundaries of action instances with specific clas…
Action ClassificationAction DetectionBoundary Content Graph Neural Network for Temporal Action Proposal Generation
Temporal action proposal generation plays an important role in video action understanding, which requires localizing high-quality action content precisely. However, generating temporal proposals with both precise boundar…
Action DetectionAction UnderstandingGraph Neural NetworkTemporal Action Localization+1