Action Graphs: Weakly-supervised Action Localization with Graph Convolution Networks
We present a method for weakly-supervised action localization based on graph convolutions. In order to find and classify video time segments that correspond to relevant action classes, a system must be able to both identify discriminative time segments in each video, and identify the full extent of each action. Achieving this with weak video level labels requires the system to use similarity and dissimilarity between moments across videos in the training data to understand both how an action appears, as well as the sub-actions that comprise the action's full extent. However, current methods do not make explicit use of similarity between video moments to inform the localization and classification predictions. We present a novel method that uses graph convolutions to explicitly model similarity between video moments. Our method utilizes similarity graphs that encode appearance and motion, and pushes the state of the art on THUMOS '14, ActivityNet 1.2, and Charades for weakly supervised action localization.
Code (0)
등록된 구현이 없습니다.
Tasks
Action LocalizationWeakly Supervised Action LocalizationSimilar Papers 제목 키워드 기반
Hide-and-Seek: Forcing a Network to be Meticulous for Weakly-supervised Object and Action Localization
We propose `Hide-and-Seek', a weakly-supervised framework that aims to improve object localization in images and action localization in videos. Most existing weakly-supervised methods localize only the most discriminativ…
Action LocalizationObjectObject LocalizationWeakly Supervised Action Localization+1PivoTAL: Prior-Driven Supervision for Weakly-Supervised Temporal Action Localization
Weakly-supervised Temporal Action Localization (WTAL) attempts to localize the actions in untrimmed videos using only video-level supervision. Most recent works approach WTAL from a localization-by-classification per…
Action LocalizationTemporal Action LocalizationWeakly Supervised Action LocalizationWeakly-supervised Temporal Action LocalizationLearning Temporal Co-Attention Models for Unsupervised Video Action Localization
Temporal action localization (TAL) in untrimmed videos recently receives tremendous research enthusiasm. To our best knowledge, this is the first attempt in the literature to explore this task under an unsupervised setti…
Action LocalizationClusteringTemporal Action LocalizationTripletCross-Attentional Audio-Visual Fusion for Weakly-Supervised Action Localization
Temporally localizing actions in videos is one of the key components for video understanding. Learning from weakly-labelled data is seen a potential solution towards avoiding expensive frame-level annotations. Different …
Action LocalizationVideo UnderstandingWeakly Supervised Action LocalizationAction Unit Memory Network for Weakly Supervised Temporal Action Localization
Weakly supervised temporal action localization aims to detect and localize actions in untrimmed videos with only video-level labels during training. However, without frame-level annotations, it is challenging to achieve …
Action LocalizationDiversityTemporal Action LocalizationWeakly Supervised Action Localization+1