Batch-Based Activity Recognition from Egocentric Photo-Streams
Activity recognition from long unstructured egocentric photo-streams has several applications in assistive technology such as health monitoring and frailty detection, just to name a few. However, one of its main technical challenges is to deal with the low frame rate of wearable photo-cameras, which causes abrupt appearance changes between consecutive frames. In consequence, important discriminatory low-level features from motion such as optical flow cannot be estimated. In this paper, we present a batch-driven approach for training a deep learning architecture that strongly rely on Long short-term units to tackle this problem. We propose two different implementations of the same approach that process a photo-stream sequence using batches of fixed size with the goal of capturing the temporal evolution of high-level features. The main difference between these implementations is that one explicitly models consecutive batches by overlapping them. Experimental results over a public dataset acquired by three users demonstrate the validity of the proposed architectures to exploit the temporal evolution of convolutional features over time without relying on event boundaries.
Code (0)
등록된 구현이 없습니다.
Tasks
Activity RecognitionOptical Flow EstimationSimilar Papers 제목 키워드 기반
On the Role of Event Boundaries in Egocentric Activity Recognition from Photostreams
Event boundaries play a crucial role as a pre-processing step for detection, localization, and recognition tasks of human activities in videos. Typically, although their intrinsic subjectiveness, temporal bounds are prov…
Action RecognitionActivity RecognitionEgocentric Activity RecognitionTemporal Action LocalizationBatch-based Activity Recognition from Egocentric Photo-Streams Revisited
Wearable cameras can gather large a\-mounts of image data that provide rich visual information about the daily activities of the wearer. Motivated by the large number of health applications that could be enabled by the a…
Activity RecognitionSR-Clustering: Semantic Regularized Clustering for Egocentric Photo Streams Segmentation
While wearable cameras are becoming increasingly popular, locating relevant information in large unstructured collections of egocentric images is still a tedious and time consuming processes. This paper addresses the pro…
ClusteringTowards Emotion Retrieval in Egocentric PhotoStream
The availability and use of egocentric data are rapidly increasing due to the growing use of wearable cameras. Our aim is to study the effect (positive, neutral or negative) of egocentric images or events on an observer.…
General ClassificationRetrievalMACNet: Multi-scale Atrous Convolution Networks for Food Places Classification in Egocentric Photo-streams
First-person (wearable) camera continually captures unscripted interactions of the camera user with objects, people, and scenes reflecting his personal and relational tendencies. One of the preferences of people is their…
General Classification