paper-with-me

홈 › Papers

Self-Supervised Learning of Gait-Based Biomarkers

2023-07-30 · R. James Cotton, J. D. Peiffer, Kunal Shah, Allison DeLillo, Anthony Cimorelli, Shawana Anarwala, Kayan Abdou, Tasos Karakostas

Markerless motion capture (MMC) is revolutionizing gait analysis in clinical settings by making it more accessible, raising the question of how to extract the most clinically meaningful information from gait data. In multiple fields ranging from image processing to natural language processing, self-supervised learning (SSL) from large amounts of unannotated data produces very effective representations for downstream tasks. However, there has only been limited use of SSL to learn effective representations of gait and movement, and it has not been applied to gait analysis with MMC. One SSL objective that has not been applied to gait is contrastive learning, which finds representations that place similar samples closer together in the learned space. If the learned similarity metric captures clinically meaningful differences, this could produce a useful representation for many downstream clinical tasks. Contrastive learning can also be combined with causal masking to predict future timesteps, which is an appealing SSL objective given the dynamical nature of gait. We applied these techniques to gait analyses performed with MMC in a rehabilitation hospital from a diverse clinical population. We find that contrastive learning on unannotated gait data learns a representation that captures clinically meaningful information. We probe this learned representation using the framework of biomarkers and show it holds promise as both a diagnostic and response biomarker, by showing it can accurately classify diagnosis from gait and is responsive to inpatient therapy, respectively. We ultimately hope these learned representations will enable predictive and prognostic gait-based biomarkers that can facilitate precision rehabilitation through greater use of MMC to quantify movement in rehabilitation.

📄 PDF Abstract BibTeX arXiv:2307.16321

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningDiagnosticMarkerless Motion CaptureSelf-Supervised Learning

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

SelfGait: A Spatiotemporal Representation Learning Method for Self-supervised Gait Recognition

2021-03-27 · Yiqun Liu, Yi Zeng, Jian Pu, Hongming Shan 외

Gait recognition plays a vital role in human identification since gait is a unique biometric feature that can be perceived at a distance. Although existing gait recognition methods can learn gait features from gait seque…

Gait RecognitionRepresentation Learning

A Self-Supervised Gait Encoding Approach with Locality-Awareness for 3D Skeleton Based Person Re-Identification

2020-09-05 · Haocong Rao, Siqi Wang, Xiping Hu, Mingkui Tan 외

Person re-identification (Re-ID) via gait features within 3D skeleton sequences is a newly-emerging topic with several advantages. Existing solutions either rely on hand-crafted descriptors or supervised gait representat…

Contrastive LearningPerson Re-IdentificationRepresentation LearningSelf-Supervised Learning

On Model and Data Scaling for Skeleton-based Self-Supervised Gait Recognition

2025-04-10 · Adrian Cosma, Andy Cǎtrunǎ, Emilian Rǎdoi

Gait recognition from video streams is a challenging problem in computer vision biometrics due to the subtle differences between gaits and numerous confounding factors. Recent advancements in self-supervised pretraining …

Gait Recognition

Self-Supervised Gait Encoding with Locality-Aware Attention for Person Re-Identification

2020-08-21 · Haocong Rao, Siqi Wang, Xiping Hu, Mingkui Tan 외

Gait-based person re-identification (Re-ID) is valuable for safety-critical applications, and using only 3D skeleton data to extract discriminative gait features for person Re-ID is an emerging open topic. Existing metho…

Person Re-Identification

GaitForeMer: Self-Supervised Pre-Training of Transformers via Human Motion Forecasting for Few-Shot Gait Impairment Severity Estimation

2022-06-30 · Mark Endo, Kathleen L. Poston, Edith V. Sullivan, Li Fei-Fei 외

Parkinson's disease (PD) is a neurological disorder that has a variety of observable motor-related symptoms such as slow movement, tremor, muscular rigidity, and impaired posture. PD is typically diagnosed by evaluating …

Motion Forecastingseverity prediction