paper-with-me

홈 › Papers

Multi-Level Temporal Pyramid Network for Action Detection

2020-08-07 · Xiang Wang, Changxin Gao, Shiwei Zhang, Nong Sang

Currently, one-stage frameworks have been widely applied for temporal action detection, but they still suffer from the challenge that the action instances span a wide range of time. The reason is that these one-stage detectors, e.g., Single Shot Multi-Box Detector (SSD), extract temporal features only applying a single-level layer for each head, which is not discriminative enough to perform classification and regression. In this paper, we propose a Multi-Level Temporal Pyramid Network (MLTPN) to improve the discrimination of the features. Specially, we first fuse the features from multiple layers with different temporal resolutions, to encode multi-layer temporal information. We then apply a multi-level feature pyramid architecture on the features to enhance their discriminative abilities. Finally, we design a simple yet effective feature fusion module to fuse the multi-level multi-scale features. By this means, the proposed MLTPN can learn rich and discriminative features for different action instances with different durations. We evaluate MLTPN on two challenging datasets: THUMOS'14 and Activitynet v1.3, and the experimental results show that MLTPN obtains competitive performance on Activitynet v1.3 and outperforms the state-of-the-art approaches on THUMOS'14 significantly.

📄 PDF Abstract BibTeX arXiv:2008.03270

Code (0)

등록된 구현이 없습니다.

Tasks

Action Detection

Similar Papers 제목 키워드 기반

Progressive Boundary Refinement Network for Temporal Action Detection

2020-04-03 · AAAI 2020 4 · Qinying Liu, Zilei Wang

Temporal action detection is a challenging task due to vagueness of action boundaries. To tackle this issue, we propose an end-to-end progressive boundary refinement network (PBRNet) in this paper. PBRNet belongs to t…

Action Detection

PDAN: Pyramid Dilated Attention Network for Action Detection

2021-01-05 · Rui Dai, Srijan Das, Luca Minciullo, Lorenzo Garattoni 외

Handling long and complex temporal information is an important challenge for action detection tasks. This challenge is further aggravated by densely distributed actions in untrimmed videos. Previous action detection meth…

Action DetectionAction LocalizationMulti-Label ClassificationTemporal Action Localization

Mumpy: Multilateral Temporal-view Pyramid Transformer for Video Inpainting Detection

2024-04-17 · Ying Zhang, Yuezun Li, Bo Peng, Jiaran Zhou 외

The task of video inpainting detection is to expose the pixel-level inpainted regions within a video sequence. Existing methods usually focus on leveraging spatial and temporal inconsistencies. However, these methods typ…

DecoderDiversityVideo Inpainting

Cascaded Pyramid Mining Network for Weakly Supervised Temporal Action Localization

2018-10-28 · Haisheng Su, Xu Zhao, Tianwei Lin

Weakly supervised temporal action localization, which aims at temporally locating action instances in untrimmed videos using only video-level class labels during training, is an important yet challenging problem in video…

Action LocalizationGeneral ClassificationTemporal Action LocalizationVideo Classification+1

Generic Event Boundary Detection in Video with Pyramid Features

2023-01-11 · Van Thong Huynh, Hyung-Jeong Yang, Guee-Sang Lee, Soo-Hyung Kim

Generic event boundary detection (GEBD) aims to split video into chunks at a broad and diverse set of actions as humans naturally perceive event boundaries. In this study, we present an approach that considers the correl…

Boundary DetectionDecoderGeneric Event Boundary Detection