Learning from the Best: Contrastive Representations Learning Across Sensor Locations for Wearable Activity Recognition
We address the well-known wearable activity recognition problem of having to work with sensors that are non-optimal in terms of information they provide but have to be used due to wearability/usability concerns (e.g. the need to work with wrist-worn IMUs because they are embedded in most smart watches). To mitigate this problem we propose a method that facilitates the use of information from sensors that are only present during the training process and are unavailable during the later use of the system. The method transfers information from the source sensors to the latent representation of the target sensor data through contrastive loss that is combined with the classification loss during joint training. We evaluate the method on the well-known PAMAP2 and Opportunity benchmarks for different combinations of source and target sensors showing average (over all activities) F1 score improvements of between 5% and 13% with the improvement on individual activities, particularly well suited to benefit from the additional information going up to between 20% and 40%.
Code (0)
등록된 구현이 없습니다.
Tasks
Activity RecognitionWearable Activity RecognitionSimilar Papers 제목 키워드 기반
COCOA: Cross Modality Contrastive Learning for Sensor Data
Self-Supervised Learning (SSL) is a new paradigm for learning discriminative representations without labelled data and has reached comparable or even state-of-the-art results in comparison to supervised counterparts. Con…
Contrastive LearningSelf-Supervised LearningLeveraging Contrastive Learning for Few-shot Geolocation of Social Posts
Social geolocation is an important problem of predicting the originating locations of social media posts. However, this task is challenging due to the need for a substantial volume of training data, alongside well-annota…
Contrastive LearningSelf-supervised New Activity Detection in Sensor-based Smart Environments
With the rapid advancement of ubiquitous computing technology, human activity analysis based on time series data from a diverse range of sensors enables the delivery of more intelligent services. Despite the importance o…
Action DetectionActivity DetectionActivity RecognitionContrastive Learning+4C-SL: Contrastive Sound Localization with Inertial-Acoustic Sensors
Human brain employs perceptual information about the head and eye movements to update the spatial relationship between the individual and the surrounding environment. Based on this cognitive process known as spatial upda…
Graph-Aware Contrasting for Multivariate Time-Series Classification
Contrastive learning, as a self-supervised learning paradigm, becomes popular for Multivariate Time-Series (MTS) classification. It ensures the consistency across different views of unlabeled samples and then learns effe…
ClassificationContrastive LearningSelf-Supervised LearningTime Series+1