Efficient Activity Detection in Untrimmed Video with Max-Subgraph Search
We propose an efficient approach for activity detection in video that unifies activity categorization with space-time localization. The main idea is to pose activity detection as a maximum-weight connected subgraph problem. Offline, we learn a binary classifier for an activity category using positive video exemplars that are "trimmed" in time to the activity of interest. Then, given a novel \emph{untrimmed} video sequence, we decompose it into a 3D array of space-time nodes, which are weighted based on the extent to which their component features support the learned activity model. To perform detection, we then directly localize instances of the activity by solving for the maximum-weight connected subgraph in the test video's space-time graph. We show that this detection strategy permits an efficient branch-and-cut solution for the best-scoring---and possibly non-cubically shaped---portion of the video for a given activity classifier. The upshot is a fast method that can search a broader space of space-time region candidates than was previously practical, which we find often leads to more accurate detection. We demonstrate the proposed algorithm on four datasets, and we show its speed and accuracy advantages over multiple existing search strategies.
Code (0)
등록된 구현이 없습니다.
Tasks
Action DetectionActivity DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Untrimmed Video Classification for Activity Detection: submission to ActivityNet Challenge
Current state-of-the-art human activity recognition is focused on the classification of temporally trimmed videos in which only one action occurs per frame. We propose a simple, yet effective, method for the temporal det…
Action DetectionActivity DetectionActivity RecognitionBinary Classification+4Deep Learning-based Action Detection in Untrimmed Videos: A Survey
Understanding human behavior and activity facilitates advancement of numerous real-world applications, and is critical for video analysis. Despite the progress of action recognition algorithms in trimmed videos, the majo…
Action DetectionAction RecognitionActivity DetectionDeep LearningGabriella: An Online System for Real-Time Activity Detection in Untrimmed Security Videos
Activity detection in security videos is a difficult problem due to multiple factors such as large field of view, presence of multiple activities, varying scales and viewpoints, and its untrimmed nature. The existing res…
Action DetectionActivity DetectionFast Temporal Activity Proposals for Efficient Detection of Human Actions in Untrimmed Videos
In many large-scale video analysis scenarios, one is interested in localizing and recognizing human activities that occur in short temporal intervals within long untrimmed videos. Current approaches for activity detectio…
Action DetectionAction RecognitionActivity DetectionTemporal Action LocalizationRevisiting Few-shot Activity Detection with Class Similarity Control
Many interesting events in the real world are rare making preannotated machine learning ready videos a rarity in consequence. Thus, temporal activity detection models that are able to learn from a few examples are desira…
Action DetectionActivity DetectionVideo Classification