Generalized Zero-Shot Learning for Action Recognition with Web-Scale Video Data
Action recognition in surveillance video makes our life safer by detecting the criminal events or predicting violent emergencies. However, efficient action recognition is not free of difficulty. First, there are so many action classes in daily life that we cannot pre-define all possible action classes beforehand. Moreover, it is very hard to collect real-word videos for certain particular actions such as steal and street fight due to legal restrictions and privacy protection. These challenges make existing data-driven recognition methods insufficient to attain desired performance. Zero-shot learning is potential to be applied to solve these issues since it can perform classification without positive example. Nevertheless, current zero-shot learning algorithms have been studied under the unreasonable setting where seen classes are absent during the testing phase. Motivated by this, we study the task of action recognition in surveillance video under a more realistic \emph{generalized zero-shot setting}, where testing data contains both seen and unseen classes. To our best knowledge, this is the first work to study video action recognition under the generalized zero-shot setting. We firstly perform extensive empirical studies on several existing zero-shot leaning approaches under this new setting on a web-scale video data. Our experimental results demonstrate that, under the generalize setting, typical zero-shot learning methods are no longer effective for the dataset we applied. Then, we propose a method for action recognition by deploying generalized zero-shot learning, which transfers the knowledge of web video to detect the anomalous actions in surveillance videos. To verify the effectiveness of our proposed method, we further construct a new surveillance video dataset consisting of nine action classes related to the public safety situation.
Code (0)
등록된 구현이 없습니다.
Tasks
Action RecognitionGeneralized Zero-Shot LearningTemporal Action LocalizationZero-Shot LearningSimilar Papers 제목 키워드 기반
Out-of-Distribution Detection for Generalized Zero-Shot Action Recognition
Generalized zero-shot action recognition is a challenging problem, where the task is to recognize new action categories that are unavailable during the training stage, in addition to the seen action categories. Existing …
Action RecognitionAction Recognition In VideosOut-of-Distribution DetectionTemporal Action Localization+1A New Split for Evaluating True Zero-Shot Action Recognition
Zero-shot action recognition is the task of classifying action categories that are not available in the training set. In this setting, the standard evaluation protocol is to use existing action recognition datasets(e.g. …
Action RecognitionFew-Shot action recognitionFew Shot Action RecognitionZero-Shot Action Recognition+1Syntactically Guided Generative Embeddings for Zero-Shot Skeleton Action Recognition
We introduce SynSE, a novel syntactically guided generative approach for Zero-Shot Learning (ZSL). Our end-to-end approach learns progressively refined generative embedding spaces constrained within and across the involv…
Action RecognitionGeneralized Zero-Shot LearningGeneralized Zero Shot skeletal action recognitionPOS+2Continual Learning Improves Zero-Shot Action Recognition
Zero-shot action recognition requires a strong ability to generalize from pre-training and seen classes to novel unseen classes. Similarly, continual learning aims to develop models that can generalize effectively and le…
Action RecognitionContinual LearningZero-Shot Action RecognitionZero-Shot LearningLearning the Redundancy-free Features for Generalized Zero-Shot Object Recognition
Zero-shot object recognition or zero-shot learning aims to transfer the object recognition ability among the semantically related categories, such as fine-grained animal or bird species. However, the images of different …
Generalized Zero-Shot LearningObjectObject RecognitionZero-Shot Learning