Generative Adversarial Graph Convolutional Networks for Human Action Synthesis
Synthesising the spatial and temporal dynamics of the human body skeleton remains a challenging task, not only in terms of the quality of the generated shapes, but also of their diversity, particularly to synthesise realistic body movements of a specific action (action conditioning). In this paper, we propose Kinetic-GAN, a novel architecture that leverages the benefits of Generative Adversarial Networks and Graph Convolutional Networks to synthesise the kinetics of the human body. The proposed adversarial architecture can condition up to 120 different actions over local and global body movements while improving sample quality and diversity through latent space disentanglement and stochastic variations. Our experiments were carried out in three well-known datasets, where Kinetic-GAN notably surpasses the state-of-the-art methods in terms of distribution quality metrics while having the ability to synthesise more than one order of magnitude regarding the number of different actions. Our code and models are publicly available at https://github.com/DegardinBruno/Kinetic-GAN.
Code (1)
Tasks
Action GenerationDisentanglementDiversityHuman action generationMotion SynthesisVideo GenerationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Adversarial Attack on Skeleton-based Human Action Recognition
Deep learning models achieve impressive performance for skeleton-based human action recognition. However, the robustness of these models to adversarial attacks remains largely unexplored due to their complex spatio-tempo…
Action RecognitionAdversarial AttackSkeleton Based Action RecognitionTemporal Action LocalizationGraphCGAN: Convolutional Graph Neural Network with Generative Adversarial Networks
Graph convolutional networks (GCN) achieved superior performances in graph-based semi-supervised learning (SSL) tasks. Generative adversarial networks (GAN) also show the ability to increase the performance in SSL. Howe…
Graph Neural NetworkHierarchical Graph-Convolutional Variational AutoEncoding for Generative Modelling of Human Motion
Models of human motion commonly focus either on trajectory prediction or action classification but rarely both. The marked heterogeneity and intricate compositionality of human motion render each task vulnerable to the d…
Action ClassificationTrajectory PredictionDiscrimNet: Semi-Supervised Action Recognition from Videos using Generative Adversarial Networks
We propose an action recognition framework using Gen- erative Adversarial Networks. Our model involves train- ing a deep convolutional generative adversarial network (DCGAN) using a large video activity dataset without l…
Action RecognitionGenerative Adversarial NetworkTemporal Action LocalizationUnsupervised Pre-trainingSSGAN: Secure Steganography Based on Generative Adversarial Networks
In this paper, a novel strategy of Secure Steganograpy based on Generative Adversarial Networks is proposed to generate suitable and secure covers for steganography. The proposed architecture has one generative network, …
Steganalysis