Assessing the State of Self-Supervised Human Activity Recognition using Wearables
The emergence of self-supervised learning in the field of wearables-based human activity recognition (HAR) has opened up opportunities to tackle the most pressing challenges in the field, namely to exploit unlabeled data to derive reliable recognition systems for scenarios where only small amounts of labeled training samples can be collected. As such, self-supervision, i.e., the paradigm of 'pretrain-then-finetune' has the potential to become a strong alternative to the predominant end-to-end training approaches, let alone hand-crafted features for the classic activity recognition chain. Recently a number of contributions have been made that introduced self-supervised learning into the field of HAR, including, Multi-task self-supervision, Masked Reconstruction, CPC, and SimCLR, to name but a few. With the initial success of these methods, the time has come for a systematic inventory and analysis of the potential self-supervised learning has for the field. This paper provides exactly that. We assess the progress of self-supervised HAR research by introducing a framework that performs a multi-faceted exploration of model performance. We organize the framework into three dimensions, each containing three constituent criteria, such that each dimension captures specific aspects of performance, including the robustness to differing source and target conditions, the influence of dataset characteristics, and the feature space characteristics. We utilize this framework to assess seven state-of-the-art self-supervised methods for HAR, leading to the formulation of insights into the properties of these techniques and to establish their value towards learning representations for diverse scenarios.
Code (0)
등록된 구현이 없습니다.
Tasks
Activity RecognitionDomain AdaptationHuman Activity RecognitionSelf-Supervised LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Contrastive Learning with Cross-Modal Knowledge Mining for Multimodal Human Activity Recognition
Human Activity Recognition is a field of research where input data can take many forms. Each of the possible input modalities describes human behaviour in a different way, and each has its own strengths and weaknesses. W…
Activity RecognitionContrastive LearningHuman Activity RecognitionRetrieval+1Self-supervised Human Activity Recognition by Learning to Predict Cross-Dimensional Motion
We propose the use of self-supervised learning for human activity recognition with smartphone accelerometer data. Our proposed solution consists of two steps. First, the representations of unlabeled input signals are lea…
Activity RecognitionHuman Activity RecognitionSelf-Supervised LearningSelfAct: Personalized Activity Recognition based on Self-Supervised and Active Learning
Supervised Deep Learning (DL) models are currently the leading approach for sensor-based Human Activity Recognition (HAR) on wearable and mobile devices. However, training them requires large amounts of labeled data whos…
Active LearningActivity RecognitionHuman Activity RecognitionSelfHAR: Improving Human Activity Recognition through Self-training with Unlabeled Data
Machine learning and deep learning have shown great promise in mobile sensing applications, including Human Activity Recognition. However, the performance of such models in real-world settings largely depends on the avai…
Activity RecognitionData AugmentationHuman Activity RecognitionSubject Invariant Contrastive Learning for Human Activity Recognition
The high cost of annotating data makes self-supervised approaches, such as contrastive learning methods, appealing for Human Activity Recognition (HAR). Effective contrastive learning relies on selecting informative posi…
Human Activity RecognitionContrastive Learning