Extreme Low Resolution Activity Recognition with Multi-Siamese Embedding Learning
This paper presents an approach for recognizing human activities from extreme low resolution (e.g., 16x12) videos. Extreme low resolution recognition is not only necessary for analyzing actions at a distance but also is crucial for enabling privacy-preserving recognition of human activities. We design a new two-stream multi-Siamese convolutional neural network. The idea is to explicitly capture the inherent property of low resolution (LR) videos that two images originated from the exact same scene often have totally different pixel values depending on their LR transformations. Our approach learns the shared embedding space that maps LR videos with the same content to the same location regardless of their transformations. We experimentally confirm that our approach of jointly learning such transform robust LR video representation and the classifier outperforms the previous state-of-the-art low resolution recognition approaches on two public standard datasets by a meaningful margin.
Code (0)
등록된 구현이 없습니다.
Tasks
Activity RecognitionPrivacy PreservingSimilar Papers 제목 키워드 기반
Extreme Low Resolution Activity Recognition with Confident Spatial-Temporal Attention Transfer
Activity recognition on extreme low-resolution videos, e.g., a resolution of 12*16 pixels, plays a vital role in far-view surveillance and privacy-preserving multimedia analysis. Low-resolution videos only contain limite…
Activity RecognitionPrivacy PreservingTransfer LearningPrivacy-Preserving Human Activity Recognition from Extreme Low Resolution
Privacy protection from surreptitious video recordings is an important societal challenge. We desire a computer vision system (e.g., a robot) that can recognize human activities and assist our daily life, yet ensure that…
Activity RecognitionHuman Activity RecognitionPrivacy PreservingSuper-ResolutionSiamese Networks for Weakly Supervised Human Activity Recognition
Deep learning has been successfully applied to human activity recognition. However, training deep neural networks requires explicitly labeled data which is difficult to acquire. In this paper, we present a model with mul…
Activity RecognitionHuman Activity RecognitionPrivacy-Preserving Action Recognition for Smart Hospitals using Low-Resolution Depth Images
Computer-vision hospital systems can greatly assist healthcare workers and improve medical facility treatment, but often face patient resistance due to the perceived intrusiveness and violation of privacy associated with…
Action RecognitionActivity RecognitionPrivacy PreservingSuper-Resolution+1Sequence Metric Learning as Synchronization of Recurrent Neural Networks
Sequence metric learning is becoming a widely adopted approach for various applications dealing with sequential multi-variate data such as activity recognition or natural language processing and is most of the time tackl…
Activity RecognitionMetric LearningRepresentation Learning