Hierarchical Temporal Convolution Network:Towards Privacy-Centric Activity Recognition
In response to the healthcare issues associated with the ageing population, various ambient assisted living technologies are being developed. To mitigate privacy concerns related to cloud-based data processing, recent methods have shifted towards using edge devices for local data processing. Despite their perceived benefits, the limited computational resources of these edge devices present a significant challenge for real-time performance, which is often an imperative requirement. However, recent computer vision-based methods for recognising activities of daily living among the elderly face increased computational complexity when capturing the multi-scale temporal context essential for accurate activity recognition. In this context, we propose HT-ConvNet (Hierarchical Temporal Convolution Network) to capture multi-scale temporal information without increasing computational complexity. HT-ConvNet employs exponentially increasing receptive fields across successive convolution layers to enable efficient hierarchical extraction of temporal features. Furthermore, HT-ConvNet provides an adaptive weighting mechanism to emphasise the most important features. Experimental results show that the multi-scale temporal feature extraction and the feature-weighted fusion mechanisms outperform existing methods in enhancing accuracy without increasing model complexity. The code is publicly available in: https://github.com/Gbouna/HT-ConvNet.
Code (1)
Tasks
Activity RecognitionSkeleton Based Action RecognitionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Attention is All We Need: Nailing Down Object-centric Attention for Egocentric Activity Recognition
In this paper we propose an end-to-end trainable deep neural network model for egocentric activity recognition. Our model is built on the observation that egocentric activities are highly characterized by the objects and…
Activity RecognitionAllEgocentric Activity RecognitionHand SegmentationEgocentric Activity Recognition with Multimodal Fisher Vector
With the increasing availability of wearable devices, research on egocentric activity recognition has received much attention recently. In this paper, we build a Multimodal Egocentric Activity dataset which includes egoc…
Activity RecognitionEgocentric Activity RecognitionCompact CNN for Indexing Egocentric Videos
While egocentric video is becoming increasingly popular, browsing it is very difficult. In this paper we present a compact 3D Convolutional Neural Network (CNN) architecture for long-term activity recognition in egocentr…
Activity RecognitionOptical Flow EstimationAutonomous Human Activity Classification from Ego-vision Camera and Accelerometer Data
There has been significant amount of research work on human activity classification relying either on Inertial Measurement Unit (IMU) data or data from static cameras providing a third-person view. Using only IMU data li…
General ClassificationMultimodal Activity RecognitionHierarchical Visual-Textual Graph for Temporal Activity Localization via Language
Temporal Activity Localization via Language (TALL) in video is a recently proposed challenging vision task, and tackling it requires fine-grained understanding of the video content, however, this is overlooked by most of…
Sentence