Bootstrapped Representation Learning for Skeleton-Based Action Recognition
In this work, we study self-supervised representation learning for 3D skeleton-based action recognition. We extend Bootstrap Your Own Latent (BYOL) for representation learning on skeleton sequence data and propose a new data augmentation strategy including two asymmetric transformation pipelines. We also introduce a multi-viewpoint sampling method that leverages multiple viewing angles of the same action captured by different cameras. In the semi-supervised setting, we show that the performance can be further improved by knowledge distillation from wider networks, leveraging once more the unlabeled samples. We conduct extensive experiments on the NTU-60 and NTU-120 datasets to demonstrate the performance of our proposed method. Our method consistently outperforms the current state of the art on both linear evaluation and semi-supervised benchmarks.
Code (0)
등록된 구현이 없습니다.
Tasks
Action RecognitionData AugmentationKnowledge DistillationLinear evaluationRepresentation LearningSkeleton Based Action RecognitionUnsupervised Skeleton Based Action RecognitionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Skeleton Cloud Colorization for Unsupervised 3D Action Representation Learning
Skeleton-based human action recognition has attracted increasing attention in recent years. However, most of the existing works focus on supervised learning which requiring a large number of annotated action sequences th…
3D Action RecognitionAction RecognitionColorizationRepresentation Learning+1Self-Supervised 3D Action Representation Learning with Skeleton Cloud Colorization
3D Skeleton-based human action recognition has attracted increasing attention in recent years. Most of the existing work focuses on supervised learning which requires a large number of labeled action sequences that are o…
3D Action RecognitionAction RecognitionColorizationRepresentation Learning+3Toward Universal Skeleton-Based Action Recognition across Heterogeneous Skeletons and Open Vocabularies
Skeleton data used for action recognition are acquired from a wide range of sources, including depth sensors, marker-based motion capture systems, and 2D/3D pose estimators. These sources yield skeletons that differ in j…
Contrastive LearningAction RecognitionSkeleMotion: A New Representation of Skeleton Joint Sequences Based on Motion Information for 3D Action Recognition
Due to the availability of large-scale skeleton datasets, 3D human action recognition has recently called the attention of computer vision community. Many works have focused on encoding skeleton data as skeleton image re…
3D Action RecognitionAction RecognitionSkeleton Based Action RecognitionTemporal Action LocalizationSkeleton-Contrastive 3D Action Representation Learning
This paper strives for self-supervised learning of a feature space suitable for skeleton-based action recognition. Our proposal is built upon learning invariances to input skeleton representations and various skeleton au…
Action RecognitionContrastive LearningFew-Shot Skeleton-Based Action RecognitionRepresentation Learning+4