paper-with-me

Papers

RelCon: Relative Contrastive Learning for a Motion Foundation Model for Wearable Data

2024-11-27 · Maxwell A. Xu, Jaya Narain, Gregory Darnell, Haraldur Hallgrimsson, Hyewon Jeong, Darren Forde, Richard Fineman, Karthik J. Raghuram, James M. Rehg, Shirley Ren

We present RelCon, a novel self-supervised Relative Contrastive learning approach for training a motion foundation model from wearable accelerometry sensors. First, a learnable distance measure is trained to capture motif similarity and domain-specific semantic information such as rotation invariance. Then, the learned distance provides a measurement of semantic similarity between a pair of accelerometry time-series, which we use to train our foundation model to model relative relationships across time and across subjects. The foundation model is trained on 1 billion segments from 87,376 participants, and achieves state-of-the-art performance across multiple downstream tasks, including human activity recognition and gait metric regression. To our knowledge, we are the first to show the generalizability of a foundation model with motion data from wearables across distinct evaluation tasks.

📄 PDF Abstract BibTeX arXiv:2411.18822

Code (1)

maxxu05/relcon 공식 구현 pytorch

Tasks

Activity RecognitionContrastive LearningHuman Activity RecognitionSelf-Supervised LearningSemantic SimilaritySemantic Textual SimilarityTime Series

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

Inertia-1: An Open Exploration of Wearable Motion Foundation Models

2026-07-07 · Zongzhe Xu, Aakarsh Anand, Sarah Jiang, Chuntung Zhuang 외 arxiv

Wearable motion sensing provides a continuous and scalable window into human behavior and health, making it a natural fit for foundation models, yet its pretraining and scaling principles remain poorly understood. Prior …

Human Activity RecognitionRepresentation Learning

DirRelCond3: Detecting Textual Entailment Across Languages With Conditions On Directional Text Relatedness Scores

2012-07-01 · SEMEVAL 2012 7 · Alp{\'a}r Perini
Natural Language InferenceSemantic Textual Similarity

Online Multi-level Contrastive Representation Distillation for Cross-Subject fNIRS Emotion Recognition

2024-09-24 · Zhili Lai, Chunmei Qing, Junpeng Tan, Wanxiang Luo 외

Utilizing functional near-infrared spectroscopy (fNIRS) signals for emotion recognition is a significant advancement in understanding human emotions. However, due to the lack of artificial intelligence data and algorithm…

Emotion RecognitionTransfer Learning

Large-scale Training of Foundation Models for Wearable Biosignals

2023-12-08 · Salar Abbaspourazad, Oussama Elachqar, Andrew C. Miller, Saba Emrani 외

Tracking biosignals is crucial for monitoring wellness and preempting the development of severe medical conditions. Today, wearable devices can conveniently record various biosignals, creating the opportunity to monitor …

Photoplethysmography (PPG)Self-Supervised Learning

6DoF SELD: Sound Event Localization and Detection Using Microphones and Motion Tracking Sensors on self-motioning human

2024-03-04 · Masahiro Yasuda, Shoichiro Saito, Akira Nakayama, Noboru Harada

We aim to perform sound event localization and detection (SELD) using wearable equipment for a moving human, such as a pedestrian. Conventional SELD tasks have dealt only with microphone arrays located in static position…

Sound Event Localization and Detection