Scene-aware Prediction of Diverse Human Movement Goals
Anticipation of human behaviours facilitates autonomous systems in proactive planning. Human behaviour could be stochastic due to varying goals. Human goals typically guide their own movement and could therefore help to predict the human trajectory and human motion in the long-term. To infer the human movement intentions, the environmental context plays a significant role, in addition to the social cues expressed by the individual. Previous works on human goals prediction either require semantic knowledge of the scene, or only tackle interactions with objects. In this paper, we propose a novel multi-goal prediction method using the generative model to address the stochasticity of human movement. It leverages the current RGB scene and the human pose to predict diverse potential future goals of human movement based on the Conditional Variational Autoencoder (CVAE). Our results demonstrate that our approach is capable of generating multiple movement goals in the scene via samplings in latent space of the CVAE and exhibits generalization capability across scenarios in GTA-IM dataset and PROX dataset. Code is publicly available at \href{https://github.com/Q-Y-Yang/DiverseGoalsPrediction.git}{\texttt{https://github.com/Q-Y-Yang/DiverseGoalsPrediction}}.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Multi-Condition Latent Diffusion Network for Scene-Aware Neural Human Motion Prediction
Inferring 3D human motion is fundamental in many applications, including understanding human activity and analyzing one's intention. While many fruitful efforts have been made to human motion prediction, most approaches …
Human motion predictionmotion predictionPredictionMIME: Human-Aware 3D Scene Generation
Generating realistic 3D worlds occupied by moving humans has many applications in games, architecture, and synthetic data creation. But generating such scenes is expensive and labor intensive. Recent work generates human…
2D Semantic Segmentation task 1 (8 classes)3D Semantic Scene CompletionIndoor Scene SynthesisScene GenerationTowards Diverse and Natural Scene-aware 3D Human Motion Synthesis
The ability to synthesize long-term human motion sequences in real-world scenes can facilitate numerous applications. Previous approaches for scene-aware motion synthesis are constrained by pre-defined target objects or …
DiversityMotion SynthesisSceneAware: Scene-Constrained Pedestrian Trajectory Prediction with LLM-Guided Walkability
Accurate prediction of pedestrian trajectories is essential for applications in robotics and surveillance systems. While existing approaches primarily focus on social interactions between pedestrians, they often overlook…
Pedestrian Trajectory PredictionScene UnderstandingTrajectory PredictionScene-LSTM: A Model for Human Trajectory Prediction
We develop a human movement trajectory prediction system that incorporates the scene information (Scene-LSTM) as well as human movement trajectories (Pedestrian movement LSTM) in the prediction process within static crow…
modelPredictionTrajectory Prediction