paper-with-me

홈 › Papers

Boundary-Aware Proposal Generation Method for Temporal Action Localization

2023-09-25 · Hao Zhang, Chunyan Feng, Jiahui Yang, Zheng Li, Caili Guo

The goal of Temporal Action Localization (TAL) is to find the categories and temporal boundaries of actions in an untrimmed video. Most TAL methods rely heavily on action recognition models that are sensitive to action labels rather than temporal boundaries. More importantly, few works consider the background frames that are similar to action frames in pixels but dissimilar in semantics, which also leads to inaccurate temporal boundaries. To address the challenge above, we propose a Boundary-Aware Proposal Generation (BAPG) method with contrastive learning. Specifically, we define the above background frames as hard negative samples. Contrastive learning with hard negative mining is introduced to improve the discrimination of BAPG. BAPG is independent of the existing TAL network architecture, so it can be applied plug-and-play to mainstream TAL models. Extensive experimental results on THUMOS14 and ActivityNet-1.3 demonstrate that BAPG can significantly improve the performance of TAL.

📄 PDF Abstract BibTeX arXiv:2309.13810

Code (0)

등록된 구현이 없습니다.

Tasks

Action LocalizationAction RecognitionContrastive LearningTemporal Action Localization

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

Fast Learning of Temporal Action Proposal via Dense Boundary Generator

2019-11-11 · Chuming Lin, Jian Li, Yabiao Wang, Ying Tai 외

Generating temporal action proposals remains a very challenging problem, where the main issue lies in predicting precise temporal proposal boundaries and reliable action confidence in long and untrimmed real-world videos…

General ClassificationOptical Flow EstimationregressionTemporal Action Localization

ABN: Agent-Aware Boundary Networks for Temporal Action Proposal Generation

2022-03-16 · Khoa Vo, Kashu Yamazaki, Sang Truong, Minh-Triet Tran 외

Temporal action proposal generation (TAPG) aims to estimate temporal intervals of actions in untrimmed videos, which is a challenging yet plays an important role in many tasks of video analysis and understanding. Despite…

Action DetectionTemporal Action Proposal Generation

BSN: Boundary Sensitive Network for Temporal Action Proposal Generation

2018-06-08 · ECCV 2018 9 · Tianwei Lin, Xu Zhao, Haisheng Su, Chongjing Wang 외

Temporal action proposal generation is an important yet challenging problem, since temporal proposals with rich action content are indispensable for analysing real-world videos with long duration and high proportion irre…

Action DetectionTemporal Action LocalizationTemporal Action Proposal Generation

BMN: Boundary-Matching Network for Temporal Action Proposal Generation

2019-07-23 · ICCV 2019 10 · Tianwei Lin, Xiao Liu, Xin Li, Errui Ding 외

Temporal action proposal generation is an challenging and promising task which aims to locate temporal regions in real-world videos where action or event may occur. Current bottom-up proposal generation methods can gener…

Action DetectionAction RecognitionTemporal Action LocalizationTemporal Action Proposal Generation

Boundary Content Graph Neural Network for Temporal Action Proposal Generation

2020-08-04 · ECCV 2020 8 · Yueran Bai, Yingying Wang, Yunhai Tong, Yang Yang 외

Temporal action proposal generation plays an important role in video action understanding, which requires localizing high-quality action content precisely. However, generating temporal proposals with both precise boundar…

Action DetectionAction UnderstandingGraph Neural NetworkTemporal Action Localization+1