RelCon: Relative Contrastive Learning for a Motion Foundation Model for Wearable Data
We present RelCon, a novel self-supervised Relative Contrastive learning approach for training a motion foundation model from wearable accelerometry sensors. First, a learnable distance measure is trained to capture motif similarity and domain-specific semantic information such as rotation invariance. Then, the learned distance provides a measurement of semantic similarity between a pair of accelerometry time-series, which we use to train our foundation model to model relative relationships across time and across subjects. The foundation model is trained on 1 billion segments from 87,376 participants, and achieves state-of-the-art performance across multiple downstream tasks, including human activity recognition and gait metric regression. To our knowledge, we are the first to show the generalizability of a foundation model with motion data from wearables across distinct evaluation tasks.
Code (1)
Tasks
Activity RecognitionContrastive LearningHuman Activity RecognitionSelf-Supervised LearningSemantic SimilaritySemantic Textual SimilarityTime SeriesMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Inertia-1: An Open Exploration of Wearable Motion Foundation Models
Wearable motion sensing provides a continuous and scalable window into human behavior and health, making it a natural fit for foundation models, yet its pretraining and scaling principles remain poorly understood. Prior …
Human Activity RecognitionRepresentation LearningDirRelCond3: Detecting Textual Entailment Across Languages With Conditions On Directional Text Relatedness Scores
Online Multi-level Contrastive Representation Distillation for Cross-Subject fNIRS Emotion Recognition
Utilizing functional near-infrared spectroscopy (fNIRS) signals for emotion recognition is a significant advancement in understanding human emotions. However, due to the lack of artificial intelligence data and algorithm…
Emotion RecognitionTransfer LearningLarge-scale Training of Foundation Models for Wearable Biosignals
Tracking biosignals is crucial for monitoring wellness and preempting the development of severe medical conditions. Today, wearable devices can conveniently record various biosignals, creating the opportunity to monitor …
Photoplethysmography (PPG)Self-Supervised Learning6DoF SELD: Sound Event Localization and Detection Using Microphones and Motion Tracking Sensors on self-motioning human
We aim to perform sound event localization and detection (SELD) using wearable equipment for a moving human, such as a pedestrian. Conventional SELD tasks have dealt only with microphone arrays located in static position…
Sound Event Localization and Detection