Multi-Level Temporal Pyramid Network for Action Detection
Currently, one-stage frameworks have been widely applied for temporal action detection, but they still suffer from the challenge that the action instances span a wide range of time. The reason is that these one-stage detectors, e.g., Single Shot Multi-Box Detector (SSD), extract temporal features only applying a single-level layer for each head, which is not discriminative enough to perform classification and regression. In this paper, we propose a Multi-Level Temporal Pyramid Network (MLTPN) to improve the discrimination of the features. Specially, we first fuse the features from multiple layers with different temporal resolutions, to encode multi-layer temporal information. We then apply a multi-level feature pyramid architecture on the features to enhance their discriminative abilities. Finally, we design a simple yet effective feature fusion module to fuse the multi-level multi-scale features. By this means, the proposed MLTPN can learn rich and discriminative features for different action instances with different durations. We evaluate MLTPN on two challenging datasets: THUMOS'14 and Activitynet v1.3, and the experimental results show that MLTPN obtains competitive performance on Activitynet v1.3 and outperforms the state-of-the-art approaches on THUMOS'14 significantly.
Code (0)
등록된 구현이 없습니다.
Tasks
Action DetectionSimilar Papers 제목 키워드 기반
Progressive Boundary Refinement Network for Temporal Action Detection
Temporal action detection is a challenging task due to vagueness of action boundaries. To tackle this issue, we propose an end-to-end progressive boundary refinement network (PBRNet) in this paper. PBRNet belongs to t…
Action DetectionPDAN: Pyramid Dilated Attention Network for Action Detection
Handling long and complex temporal information is an important challenge for action detection tasks. This challenge is further aggravated by densely distributed actions in untrimmed videos. Previous action detection meth…
Action DetectionAction LocalizationMulti-Label ClassificationTemporal Action LocalizationMumpy: Multilateral Temporal-view Pyramid Transformer for Video Inpainting Detection
The task of video inpainting detection is to expose the pixel-level inpainted regions within a video sequence. Existing methods usually focus on leveraging spatial and temporal inconsistencies. However, these methods typ…
DecoderDiversityVideo InpaintingCascaded Pyramid Mining Network for Weakly Supervised Temporal Action Localization
Weakly supervised temporal action localization, which aims at temporally locating action instances in untrimmed videos using only video-level class labels during training, is an important yet challenging problem in video…
Action LocalizationGeneral ClassificationTemporal Action LocalizationVideo Classification+1Generic Event Boundary Detection in Video with Pyramid Features
Generic event boundary detection (GEBD) aims to split video into chunks at a broad and diverse set of actions as humans naturally perceive event boundaries. In this study, we present an approach that considers the correl…
Boundary DetectionDecoderGeneric Event Boundary Detection