Action Anticipation By Predicting Future Dynamic Images
Human action-anticipation methods predict what is the future action by observing only a few portion of an action in progress. This is critical for applications where computers have to react to human actions as early as possible such as autonomous driving, human-robotic interaction, assistive robotics among others. In this paper, we present a method for human action anticipation by predicting the most plausible future human motion. We represent human motion using Dynamic Images and make use of tailored loss functions to encourage a generative model to produce accurate future motion prediction. Our method outperforms the currently best performing action-anticipation methods by 4% on JHMDB-21, 5.2% on UT-Interaction and 5.1% on UCF 101-24 benchmarks.
Code (0)
등록된 구현이 없습니다.
Tasks
Action AnticipationAutonomous Drivingmotion predictionSimilar Papers 제목 키워드 기반
Deep Sequence Learning for Video Anticipation: From Discrete and Deterministic to Continuous and Stochastic
Video anticipation is the task of predicting one/multiple future representation(s) given limited, partial observation. This is a challenging task due to the fact that given limited observation, the future representation …
Action AnticipationPredicting the Future: A Jointly Learnt Model for Action Anticipation
Inspired by human neurological structures for action anticipation, we present an action anticipation model that enables the prediction of plausible future actions by forecasting both the visual and temporal future. In co…
Action AnticipationGenerative Adversarial NetworkFuture Transformer for Long-term Action Anticipation
The task of predicting future actions from a video is crucial for a real-world agent interacting with others. When anticipating actions in the distant future, we humans typically consider long-term relations over the who…
Action AnticipationLong Term Action AnticipationLong Term AnticipationLearning to Anticipate Egocentric Actions by Imagination
Anticipating actions before they are executed is crucial for a wide range of practical applications, including autonomous driving and robotics. In this paper, we study the egocentric action anticipation task, which predi…
Action AnticipationAutonomous DrivingContrastive LearningUncertainty-aware Action Decoupling Transformer for Action Anticipation
Human action anticipation aims at predicting what people will do in the future based on past observations. In this paper we introduce Uncertainty-aware Action Decoupling Transformer (UADT) for action anticipation. Un…
Action Anticipation