Cross-view Action Recognition via Contrastive View-invariant Representation
Cross view action recognition (CVAR) seeks to recognize a human action when observed from a previously unseen viewpoint. This is a challenging problem since the appearance of an action changes significantly with the viewpoint. Applications of CVAR include surveillance and monitoring of assisted living facilities where is not practical or feasible to collect large amounts of training data when adding a new camera. We present a simple yet efficient CVAR framework to learn invariant features from either RGB videos, 3D skeleton data, or both. The proposed approach outperforms the current state-of-the-art achieving similar levels of performance across input modalities: 99.4% (RGB) and 99.9% (3D skeletons), 99.4% (RGB) and 99.9% (3D Skeletons), 97.3% (RGB), and 99.2% (3D skeletons), and 84.4%(RGB) for the N-UCLA, NTU-RGB+D 60, NTU-RGB+D 120, and UWA3DII datasets, respectively.
Code (0)
등록된 구현이 없습니다.
Tasks
Action RecognitionSimilar Papers 제목 키워드 기반
Trunk-branch Contrastive Network with Multi-view Deformable Aggregation for Multi-view Action Recognition
Multi-view action recognition aims to identify actions in a given multi-view scene. Traditional studies initially extracted refined features from each view, followed by implemented paired interaction and integration, but…
Action RecognitionContrastive Learning3D Human Action Representation Learning via Cross-View Consistency Pursuit
In this work, we propose a Cross-view Contrastive Learning framework for unsupervised 3D skeleton-based action Representation (CrosSCLR), by leveraging multi-view complementary supervision signal. CrosSCLR consists of bo…
Action RecognitionContrastive LearningRepresentation LearningSelf-supervised Skeleton-based Action RecognitionLearning View-Disentangled Human Pose Representation by Contrastive Cross-View Mutual Information Maximization
We introduce a novel representation learning method to disentangle pose-dependent as well as view-dependent factors from 2D human poses. The method trains a network using cross-view mutual information maximization (CV-MI…
Action RecognitionContrastive LearningDisentanglementRepresentation LearningFocalized Contrastive View-invariant Learning for Self-supervised Skeleton-based Action Recognition
Learning view-invariant representation is a key to improving feature discrimination power for skeleton-based action recognition. Existing approaches cannot effectively remove the impact of viewpoint due to the implicit v…
Action RecognitionContrastive LearningRepresentation LearningSelf-supervised Skeleton-based Action Recognition+1Multi-View Action Recognition Using Contrastive Learning
In this work, we present a method for RGB-based action recognition using multi-view videos. We present a supervised contrastive learning framework to learn a feature embedding robust to changes in viewpoint, by effective…
Action RecognitionContrastive LearningDomain Generalization