Extreme Low Resolution Activity Recognition with Confident Spatial-Temporal Attention Transfer
Activity recognition on extreme low-resolution videos, e.g., a resolution of 12*16 pixels, plays a vital role in far-view surveillance and privacy-preserving multimedia analysis. Low-resolution videos only contain limited information. Given the fact that one same activity may be represented by videos in both high resolution (HR) and extreme low resolution (eLR), it is worth studying to utilize the relevant HR data to improve the eLR activity recognition. In this work, we propose a novel Confident Spatial-Temporal Attention Transfer (CSTAT) for eLR activity recognition. CSTAT can acquire information from HR data by reducing the attention differences with a transfer-learning strategy. Besides, the credibility of the supervisory signal is also taken into consideration for a more confident transferring process. Experimental results on two well-known datasets, i.e., UCF101 and HMDB51, demonstrate that, the proposed method can effectively improve the accuracy of eLR activity recognition and achieve an accuracy of 59.23% on 12*16 videos in HMDB51, a state-of-the-art performance.
Code (0)
등록된 구현이 없습니다.
Tasks
Activity RecognitionPrivacy PreservingTransfer LearningSimilar Papers 제목 키워드 기반
Privacy-Preserving Human Activity Recognition from Extreme Low Resolution
Privacy protection from surreptitious video recordings is an important societal challenge. We desire a computer vision system (e.g., a robot) that can recognize human activities and assist our daily life, yet ensure that…
Activity RecognitionHuman Activity RecognitionPrivacy PreservingSuper-ResolutionExtreme Low Resolution Activity Recognition with Multi-Siamese Embedding Learning
This paper presents an approach for recognizing human activities from extreme low resolution (e.g., 16x12) videos. Extreme low resolution recognition is not only necessary for analyzing actions at a distance but also is …
Activity RecognitionPrivacy PreservingPrivacy-Preserving Action Recognition for Smart Hospitals using Low-Resolution Depth Images
Computer-vision hospital systems can greatly assist healthcare workers and improve medical facility treatment, but often face patient resistance due to the perceived intrusiveness and violation of privacy associated with…
Action RecognitionActivity RecognitionPrivacy PreservingSuper-Resolution+1Semi-Coupled Two-Stream Fusion ConvNets for Action Recognition at Extremely Low Resolutions
Deep convolutional neural networks (ConvNets) have been recently shown to attain state-of-the-art performance for action recognition on standard-resolution videos. However, less attention has been paid to recognition per…
Action RecognitionTemporal Action LocalizationFully-Coupled Two-Stream Spatiotemporal Networks for Extremely Low Resolution Action Recognition
A major emerging challenge is how to protect people's privacy as cameras and computer vision are increasingly integrated into our daily lives, including in smart devices inside homes. A potential solution is to capture a…
Action RecognitionTemporal Action Localization