paper-with-me

홈 › Papers

Spatio-Temporal Encoding and Decoding-Based Method for Future Human Activity Skeleton Synthesis

2024-07-08 · Tingyu Liu, Jun Huang, Chenyi Weng

Inferring future activity information based on observed activity data is a crucial step to improve the accuracy of early activity prediction. Traditional methods based on generative adversarial networks(GAN) or joint learning frameworks can achieve good prediction accuracy under low observation ratios, but they usually have high computational costs. In view of this, this paper proposes a spatio-temporal encoding and decoding-based method for future human activity skeleton synthesis. Firstly, algorithms such as time control, discrete cosine transform, and low-pass filtering are used to cut or pad the skeleton sequences. Secondly, the encoder and decoder are responsible for extracting intermediate semantic encoding from observed skeleton sequences and inferring future sequences from the intermediate semantic encoding, respectively. Finally, joint displacement error, velocity error, and acceleration error, three higher-order kinematic features, are used as key components of the loss function to optimize model parameters. Experimental results show that the proposed future skeleton synthesis algorithm performs better than some existing algorithms. It generates skeleton sequences with smaller errors and fewer model parameters, effectively providing future information for early activity prediction.

📄 PDF Abstract BibTeX arXiv:2407.05573

Code (0)

등록된 구현이 없습니다.

Tasks

Activity PredictionDecoderPrediction

Similar Papers 제목 키워드 기반

BaRISTA: Brain Scale Informed Spatiotemporal Representation of Human Intracranial Neural Activity

2025-12-13 · Lucine L. Oganesian, Saba Hashemi, Maryam M. Shanechi arxiv

Intracranial recordings have opened a unique opportunity to simultaneously measure activity across multiregional networks in the human brain. Recent works have focused on developing transformer-based neurofoundation mode…

Nonlocal operator learning for fMRI encoding and decoding tasks

2026-05-19 · Andreas Kramer, Saugat Acharya, Alice Giola, Emanuele Zappala arxiv

Functional MRI data exhibit high-dimensional spatiotemporal structure, making both prediction and decoding challenging. In this work, we investigate neural integral-operator-based models for encoding and decoding tasks i…

Representation Learning

Stecformer: Spatio-temporal Encoding Cascaded Transformer for Multivariate Long-term Time Series Forecasting

2023-05-25 · Zheng Sun, Yi Wei, Wenxiao Jia, Long Yu

Multivariate long-term time series forecasting is of great application across many domains, such as energy consumption and weather forecasting. With the development of transformer-based methods, the performance of multiv…

PredictionTime SeriesTime Series ForecastingWeather Forecasting

Probabilistic Video Generation using Holistic Attribute Control

2018-03-21 · ECCV 2018 9 · Jiawei He, Andreas Lehrmann, Joseph Marino, Greg Mori 외

Videos express highly structured spatio-temporal patterns of visual data. A video can be thought of as being governed by two factors: (i) temporally invariant (e.g., person identity), or slowly varying (e.g., activity), …

AttributeFuture predictionVideo Generation

Flexible Spatio-Temporal Networks for Video Prediction

2017-07-01 · CVPR 2017 7 · Chaochao Lu, Michael Hirsch, Bernhard Scholkopf

We describe a modular framework for video frame prediction. We refer to it as a Flexible Spatio-Temporal Network (FSTN) as it allows the extrapolation of a video sequence as well as the estimation of synthetic frames lyi…

PredictionVideo Prediction