Boundary-Aware Proposal Generation Method for Temporal Action Localization
The goal of Temporal Action Localization (TAL) is to find the categories and temporal boundaries of actions in an untrimmed video. Most TAL methods rely heavily on action recognition models that are sensitive to action labels rather than temporal boundaries. More importantly, few works consider the background frames that are similar to action frames in pixels but dissimilar in semantics, which also leads to inaccurate temporal boundaries. To address the challenge above, we propose a Boundary-Aware Proposal Generation (BAPG) method with contrastive learning. Specifically, we define the above background frames as hard negative samples. Contrastive learning with hard negative mining is introduced to improve the discrimination of BAPG. BAPG is independent of the existing TAL network architecture, so it can be applied plug-and-play to mainstream TAL models. Extensive experimental results on THUMOS14 and ActivityNet-1.3 demonstrate that BAPG can significantly improve the performance of TAL.
Code (0)
등록된 구현이 없습니다.
Tasks
Action LocalizationAction RecognitionContrastive LearningTemporal Action LocalizationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Fast Learning of Temporal Action Proposal via Dense Boundary Generator
Generating temporal action proposals remains a very challenging problem, where the main issue lies in predicting precise temporal proposal boundaries and reliable action confidence in long and untrimmed real-world videos…
General ClassificationOptical Flow EstimationregressionTemporal Action LocalizationABN: Agent-Aware Boundary Networks for Temporal Action Proposal Generation
Temporal action proposal generation (TAPG) aims to estimate temporal intervals of actions in untrimmed videos, which is a challenging yet plays an important role in many tasks of video analysis and understanding. Despite…
Action DetectionTemporal Action Proposal GenerationBSN: Boundary Sensitive Network for Temporal Action Proposal Generation
Temporal action proposal generation is an important yet challenging problem, since temporal proposals with rich action content are indispensable for analysing real-world videos with long duration and high proportion irre…
Action DetectionTemporal Action LocalizationTemporal Action Proposal GenerationBMN: Boundary-Matching Network for Temporal Action Proposal Generation
Temporal action proposal generation is an challenging and promising task which aims to locate temporal regions in real-world videos where action or event may occur. Current bottom-up proposal generation methods can gener…
Action DetectionAction RecognitionTemporal Action LocalizationTemporal Action Proposal GenerationBoundary Content Graph Neural Network for Temporal Action Proposal Generation
Temporal action proposal generation plays an important role in video action understanding, which requires localizing high-quality action content precisely. However, generating temporal proposals with both precise boundar…
Action DetectionAction UnderstandingGraph Neural NetworkTemporal Action Localization+1