RefineLoc: Iterative Refinement for Weakly-Supervised Action Localization
Video action detectors are usually trained using datasets with fully-supervised temporal annotations. Building such datasets is an expensive task. To alleviate this problem, recent methods have tried to leverage weak labeling, where videos are untrimmed and only a video-level label is available. In this paper, we propose RefineLoc, a novel weakly-supervised temporal action localization method. RefineLoc uses an iterative refinement approach by estimating and training on snippet-level pseudo ground truth at every iteration. We show the benefit of this iterative approach and present an extensive analysis of five different pseudo ground truth generators. We show the effectiveness of our model on two standard action datasets, ActivityNet v1.2 and THUMOS14. RefineLoc shows competitive results with the state-of-the-art in weakly-supervised temporal localization. Additionally, our iterative refinement process is able to significantly improve the performance of two state-of-the-art methods, setting a new state-of-the-art on THUMOS14.
Code (1)
Tasks
Action LocalizationTemporal Action LocalizationTemporal LocalizationWeakly Supervised Action LocalizationWeakly-supervised Temporal Action LocalizationSimilar Papers 제목 키워드 기반
Multiple Instance Detection Network with Online Instance Classifier Refinement
Of late, weakly supervised object detection is with great importance in object recognition. Based on deep learning, weakly supervised detectors have achieved many promising results. However, compared with fully supervise…
Multiple Instance LearningObjectobject-detectionObject Detection+2Two-Stream Consensus Network for Weakly-Supervised Temporal Action Localization
Weakly-supervised Temporal Action Localization (W-TAL) aims to classify and localize all action instances in an untrimmed video under only video-level supervision. However, without frame-level annotations, it is challeng…
Action LocalizationTemporal Action LocalizationVocal Bursts Valence PredictionWeakly Supervised Action Localization+1STAT: Towards Generalizable Temporal Action Localization
Weakly-supervised temporal action localization (WTAL) aims to recognize and localize action instances with only video-level labels. Despite the significant progress, existing methods suffer from severe performance degrad…
Action LocalizationTemporal Action LocalizationWeakly-supervised Temporal Action LocalizationPCL: Proposal Cluster Learning for Weakly Supervised Object Detection
Weakly Supervised Object Detection (WSOD), using only image-level annotations to train object detectors, is of growing importance in object recognition. In this paper, we propose a novel deep network for WSOD. Unlike pre…
image-classificationMultiple Instance LearningObjectobject-detection+3EgoFlowNet: Non-Rigid Scene Flow from Point Clouds with Ego-Motion Support
Recent weakly-supervised methods for scene flow estimation from LiDAR point clouds are limited to explicit reasoning on object-level. These methods perform multiple iterative optimizations for each rigid object, which ma…
ClusteringObjectScene Flow Estimation