CA3D: Convolutional-Attentional 3D Nets for Efficient Video Activity Recognition on the Edge
In this paper, we introduce a deep learning solution for video activity recognition that leverages an innovative combination of convolutional layers with a linear-complexity attention mechanism. Moreover, we introduce a novel quantization mechanism to further improve the efficiency of our model during both training and inference. Our model maintains a reduced computational cost, while preserving robust learning and generalization capabilities. Our approach addresses the issues related to the high computing requirements of current models, with the goal of achieving competitive accuracy on consumer and edge devices, enabling smart home and smart healthcare applications where efficiency and privacy issues are of concern. We experimentally validate our model on different established and publicly available video activity recognition benchmarks, improving accuracy over alternative models at a competitive computing cost.
Code (0)
등록된 구현이 없습니다.
Tasks
Activity RecognitionQuantizationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Learning Spatio-Temporal Features with 3D Residual Networks for Action Recognition
Convolutional neural networks with spatio-temporal 3D kernels (3D CNNs) have an ability to directly extract spatio-temporal features from videos for action recognition. Although the 3D kernels tend to overfit because of …
Action RecognitionHand-Gesture RecognitionTemporal Action LocalizationAnomaly Recognition from surveillance videos using 3D Convolutional Neural Networks
Anomalous activity recognition deals with identifying the patterns and events that vary from the normal stream. In a surveillance paradigm, these events range from abuse to fighting and road accidents to snatching, etc. …
Activity RecognitionAnomaly DetectionBinary ClassificationHuman Activity Recognition Using Cascaded Dual Attention CNN and Bi-Directional GRU Framework
Vision-based human activity recognition has emerged as one of the essential research areas in video analytics domain. Over the last decade, numerous advanced deep learning algorithms have been introduced to recognize com…
Action RecognitionActivity RecognitionComputational EfficiencyHuman Activity RecognitionVideo-FocalNets: Spatio-Temporal Focal Modulation for Video Action Recognition
Recent video recognition models utilize Transformer models for long-range spatio-temporal context modeling. Video transformer designs are based on self-attention that can model global context at a high computational cost…
Action RecognitionTemporal Action LocalizationVideo RecognitionChirality Nets for Human Pose Regression
We propose Chirality Nets, a family of deep nets that is equivariant to the "chirality transform," i.e., the transformation to create a chiral pair. Through parameter sharing, odd and even symmetry, we propose and prove …
3D Human Pose Estimation3D Pose EstimationActivity RecognitionPose Estimation+2