Self-supervised New Activity Detection in Sensor-based Smart Environments
With the rapid advancement of ubiquitous computing technology, human activity analysis based on time series data from a diverse range of sensors enables the delivery of more intelligent services. Despite the importance of exploring new activities in real-world scenarios, existing human activity recognition studies generally rely on predefined known activities and often overlook detecting new patterns (novelties) that have not been previously observed during training. Novelty detection in human activities becomes even more challenging due to (1) diversity of patterns within the same known activity, (2) shared patterns between known and new activities, and (3) differences in sensor properties of each activity dataset. We introduce CLAN, a two-tower model that leverages Contrastive Learning with diverse data Augmentation for New activity detection in sensor-based environments. CLAN simultaneously and explicitly utilizes multiple types of strongly shifted data as negative samples in contrastive learning, effectively learning invariant representations that adapt to various pattern variations within the same activity. To enhance the ability to distinguish between known and new activities that share common features, CLAN incorporates both time and frequency domains, enabling the learning of multi-faceted discriminative representations. Additionally, we design an automatic selection mechanism of data augmentation methods tailored to each dataset's properties, generating appropriate positive and negative pairs for contrastive learning. Comprehensive experiments on real-world datasets show that CLAN achieves a 9.24% improvement in AUROC compared to the best-performing baseline model.
Code (0)
등록된 구현이 없습니다.
Tasks
Action DetectionActivity DetectionActivity RecognitionContrastive LearningData AugmentationHuman Activity RecognitionNovelty DetectionRepresentation LearningSimilar Papers 제목 키워드 기반
DomusFM: A Foundation Model for Event-Based Behavioral Monitoring in Smart-Homes
Smart-home sensor-based behavioral monitoring holds significant potential for healthcare, independent living, and early detection of functional or cognitive changes. In this setting, tasks like activity recognition, pred…
Contrastive LearningActivity RecognitionPoHAR: Understanding Hyperlocal Human Activities with Pollution Sensor Networks
Low-cost air quality sensors are becoming ubiquitous in our daily lives as public awareness of air pollution continues to grow, and people take measures to monitor and improve the air they breathe indoors. Besides the st…
Activity DetectionMulti-task Self-Supervised Learning for Human Activity Detection
Deep learning methods are successfully used in applications pertaining to ubiquitous computing, health, and well-being. Specifically, the area of human activity recognition (HAR) is primarily transformed by the convoluti…
Action DetectionActivity DetectionActivity RecognitionBinary Classification+4Activity2Vec: Learning ADL Embeddings from Sensor Data with a Sequence-to-Sequence Model
Recognizing activities of daily living (ADLs) plays an essential role in analyzing human health and behavior. The widespread availability of sensors implanted in homes, smartphones, and smart watches have engendered coll…
Activity RecognitionFeature EngineeringTime SeriesTime Series AnalysisWatchHAR: Real-time On-device Human Activity Recognition System for Smartwatches
Despite advances in practical and multimodal fine-grained Human Activity Recognition (HAR), a system that runs entirely on smartwatches in unconstrained environments remains elusive. We present WatchHAR, an audio and ine…
Human Activity Recognition