The Garden of Forking Paths: Towards Multi-Future Trajectory Prediction
This paper studies the problem of predicting the distribution over multiple possible future paths of people as they move through various visual scenes. We make two main contributions. The first contribution is a new dataset, created in a realistic 3D simulator, which is based on real world trajectory data, and then extrapolated by human annotators to achieve different latent goals. This provides the first benchmark for quantitative evaluation of the models to predict multi-future trajectories. The second contribution is a new model to generate multiple plausible future trajectories, which contains novel designs of using multi-scale location encodings and convolutional RNNs over graphs. We refer to our model as Multiverse. We show that our model achieves the best results on our dataset, as well as on the real-world VIRAT/ActEV dataset (which just contains one possible future).
Code (1)
Tasks
Autonomous DrivingHuman motion predictionmotion predictionMulti-future Trajectory PredictionMulti Future Trajectory PredictionSelf-Driving CarsTrajectory ForecastingTrajectory PredictionSimilar Papers 제목 키워드 기반
The Garden of Forking Paths: Narrative Arc-Conditioned Gameplay Planning
Narrative archetypes (e.g., Hero's Journey, Three-act structure) provide universal story structures that resonate across cultures and media and are important for video game storytelling, yet existing LLM-based methods la…
The Garden of Forking Paths: Observing Dynamic Parameters Distribution in Large Language Models
A substantial gap persists in understanding the reasons behind the exceptional performance of the Transformer architecture in NLP. A particularly unexplored area involves the mechanistic description of how the distributi…
The Agentic Garden of Forking Paths
Empirical research rarely admits a unique analysis. Different analytical choices can lead to different conclusions from the same data, yet these hidden forking paths are difficult to observe. We show that AI agents captu…
Vision-based Multi-future Trajectory Prediction: A Survey
Vision-based trajectory prediction is an important task that supports safe and intelligent behaviours in autonomous systems. Many advanced approaches have been proposed over the years with improved spatial and temporal f…
Multi-future Trajectory PredictionMulti Future Trajectory PredictionPredictionSurvey+1Forking paths in financial economics
We argue that spanning large numbers of degrees of freedom in empirical analysis allows better characterizations of effects and thus improves the trustworthiness of conclusions. Our ideas are illustrated in three studies…