paper-with-me

홈 › Papers

An Elastic Shape Variational Autoencoder for Skeleton Pose Trajectories

2026-05-10 · Arafat Rahman, Shashwat Kumar, Laura E. Barnes, Anuj Srivastava arxiv

Deep generative models provide flexible frameworks for modeling complex, structured data such as images, videos, 3D objects, and texts. However, when applied to sequences of human skeletons, standard variational autoencoders (VAEs) often allocate substantial capacity to nuisance factors-such as camera orientation, subject scale, viewpoint, and execution speed-rather than the intrinsic geometry of shapes and their motion. We propose the Elastic Shape - Variational Autoencoder (ES-VAE), a geometry-aware generative model for skeletal trajectories that leverages the transported square-root velocity field (TSRVF) representation on Kendall's shape manifold. This representation inherently removes rigid translations, rotations, and global scaling of shapes, and temporal rate variability of sequences, isolating the underlying shape dynamics. The ES-VAE encoder maps skeletal sequences to a low-dimensional latent space incorporating the Riemannian logarithm map, while the decoder reconstructs sequences using the corresponding exponential map. We demonstrate the effectiveness of ES-VAE on two datasets. First, we analyze skeletal gait cycles to predict clinical mobility scores and classify subjects into healthy and post-stroke groups. Second, we evaluate action recognition on the NTU RGB+D dataset. Across both settings, ES-VAE consistently outperforms standard VAEs and a range of sequence modeling baselines, including temporal convolutional networks, transformers, and graph convolutional networks. More broadly, ES-VAE provides a principled framework for learning generative models of longitudinal data on pose shape manifolds, offering improved latent representation and downstream performance compared to existing deep learning approaches.

📄 PDF Abstract BibTeX arXiv:2605.09231

Code (0)

등록된 구현이 없습니다.

Tasks

Action Recognition

Similar Papers 제목 키워드 기반

SA-DVAE: Improving Zero-Shot Skeleton-Based Action Recognition by Disentangled Variational Autoencoders

2024-07-18 · Sheng-Wei Li, Zi-Xiang Wei, Wei-Jie Chen, Yi-Hsin Yu 외

Existing zero-shot skeleton-based action recognition methods utilize projection networks to learn a shared latent space of skeleton features and semantic embeddings. The inherent imbalance in action recognition datasets,…

Action RecognitionDisentanglementGeneralized Zero Shot skeletal action recognitionSkeleton Based Action Recognition+2

Construction of an Organ Shape Atlas Using a Hierarchical Mesh Variational Autoencoder

2025-06-18 · Zijie Wang, Ryuichi Umehara, Mitsuhiro Nakamura, Megumi Nakao

An organ shape atlas, which represents the shape and position of the organs and skeleton of a living body using a small number of parameters, is expected to have a wide range of clinical applications, including intraoper…

Position

CNN-based Euler's Elastica Inpainting with Deep Energy and Deep Image Prior

2022-07-16 · Karl Schrader, Tobias Alt, Joachim Weickert, Michael Ertel

Euler's elastica constitute an appealing variational image inpainting model. It minimises an energy that involves the total variation as well as the level line curvature. These components are transparent and make it attr…

Image Inpainting

SCALE: Semantic- and Confidence-Aware Conditional Variational Autoencoder for Zero-shot Skeleton-based Action Recognition

2026-04-02 · Soroush Oraki, Feng Ding, Jie Liang arxiv

Zero-shot skeleton-based action recognition (ZSAR) aims to recognize action classes without any training skeletons from those classes, relying instead on auxiliary semantics from text. Existing approaches frequently depe…

Action Recognition

Shape optimization in laminar flow with a label-guided variational autoencoder

2017-12-10 · Stephan Eismann, Stefan Bartzsch, Stefano Ermon

Computational design optimization in fluid dynamics usually requires to solve non-linear partial differential equations numerically. In this work, we explore a Bayesian optimization approach to minimize an object's drag …

Bayesian Optimizationregression