Learnable Pooling Methods for Video Classification
We introduce modifications to state-of-the-art approaches to aggregating local video descriptors by using attention mechanisms and function approximations. Rather than using ensembles of existing architectures, we provide an insight on creating new architectures. We demonstrate our solutions in the "The 2nd YouTube-8M Video Understanding Challenge", by using frame-level video and audio descriptors. We obtain testing accuracy similar to the state of the art, while meeting budget constraints, and touch upon strategies to improve the state of the art. Model implementations are available in https://github.com/pomonam/LearnablePoolingMethods.
Code (1)
Tasks
ClassificationGeneral ClassificationVideo ClassificationVideo UnderstandingSimilar Papers 제목 키워드 기반
Learnable pooling with Context Gating for video classification
Current methods for video analysis often extract frame-level features using pre-trained convolutional neural networks (CNNs). Such features are then aggregated over time e.g., by simple temporal averaging or more sophist…
ClassificationClusteringGeneral ClassificationVideo Classification+1Learnable Pooling in Graph Convolution Networks for Brain Surface Analysis
Brain surface analysis is essential to neuroscience, however, the complex geometry of the brain cortex hinders computational methods for this task. The difficulty arises from a discrepancy between 3D imaging data, which …
General ClassificationregressionActionVLAD: Learning spatio-temporal aggregation for action classification
In this work, we introduce a new video representation for action classification that aggregates local convolutional features across the entire spatio-temporal extent of the video. We do so by integrating state-of-the-art…
Action ClassificationClassificationGeneral ClassificationLong-video Activity Recognition+1Hierarchical Deep Recurrent Architecture for Video Understanding
This paper introduces the system we developed for the Youtube-8M Video Understanding Challenge, in which a large-scale benchmark dataset was used for multi-label video classification. The proposed framework contains hier…
ClassificationGeneral ClassificationMixture-of-ExpertsVideo Classification+1Deep Adaptive Temporal Pooling for Activity Recognition
Deep neural networks have recently achieved competitive accuracy for human activity recognition. However, there is room for improvement, especially in modeling long-term temporal importance and determining the activity r…
Activity RecognitionHuman Activity Recognition