Generalizable Low-Resource Activity Recognition with Diverse and Discriminative Representation Learning
Human activity recognition (HAR) is a time series classification task that focuses on identifying the motion patterns from human sensor readings. Adequate data is essential but a major bottleneck for training a generalizable HAR model, which assists customization and optimization of online web applications. However, it is costly in time and economy to collect large-scale labeled data in reality, i.e., the low-resource challenge. Meanwhile, data collected from different persons have distribution shifts due to different living habits, body shapes, age groups, etc. The low-resource and distribution shift challenges are detrimental to HAR when applying the trained model to new unseen subjects. In this paper, we propose a novel approach called Diverse and Discriminative representation Learning (DDLearn) for generalizable low-resource HAR. DDLearn simultaneously considers diversity and discrimination learning. With the constructed self-supervised learning task, DDLearn enlarges the data diversity and explores the latent activity properties. Then, we propose a diversity preservation module to preserve the diversity of learned features by enlarging the distribution divergence between the original and augmented domains. Meanwhile, DDLearn also enhances semantic discrimination by learning discriminative representations with supervised contrastive learning. Extensive experiments on three public HAR datasets demonstrate that our method significantly outperforms state-of-art methods by an average accuracy improvement of 9.5% under the low-resource distribution shift scenarios, while being a generic, explainable, and flexible framework. Code is available at: https://github.com/microsoft/robustlearn.
Code (1)
Tasks
Activity RecognitionContrastive LearningDiversityHuman Activity RecognitionRepresentation LearningSelf-Supervised LearningTime Series ClassificationSimilar Papers 제목 키워드 기반
Transformer-Based Contrastive Meta-Learning For Low-Resource Generalizable Activity Recognition
Deep learning has been widely adopted for human activity recognition (HAR) while generalizing a trained model across diverse users and scenarios remains challenging due to distribution shifts. The inherent low-resource c…
Activity RecognitionHuman Activity RecognitionMeta-LearningRepresentation LearningSemantic-Discriminative Mixup for Generalizable Sensor-based Cross-domain Activity Recognition
It is expensive and time-consuming to collect sufficient labeled data to build human activity recognition (HAR) models. Training on existing data often makes the model biased towards the distribution of the training data…
Activity RecognitionCross-Domain Activity RecognitionDomain AdaptationHuman Activity Recognition+1Bridging Generalization and Personalization in Human Activity Recognition via On-Device Few-Shot Learning
Human Activity Recognition (HAR) with different sensing modalities requires both strong generalization across diverse users and efficient personalization for individuals. However, conventional HAR models often fail to ge…
Human Activity RecognitionFew-Shot LearningDriver Activity Classification Using Generalizable Representations from Vision-Language Models
Driver activity classification is crucial for ensuring road safety, with applications ranging from driver assistance systems to autonomous vehicle control transitions. In this paper, we present a novel approach leveragin…
Action RecognitionS-ConvNet: A Shallow Convolutional Neural Network Architecture for Neuromuscular Activity Recognition Using Instantaneous High-Density Surface EMG Images
The concept of neuromuscular activity recognition using instantaneous high-density surface electromyography (HD-sEMG) images opens up new avenues for the development of more fluid and natural muscle-computer interfaces. …
Efficient Neural NetworkGesture RecognitionLow-latency processingMuscle-Computer Interfaces (MCIs)