Learning Underlying Physical Properties From Observations For Trajectory Prediction
In this work we present an approach that combines deep learning together with laws of Newton’s physics for accurate trajectory predictions in physical games. Our model learns to estimate physical properties and forces that generated given observations, learns the relationships between available player’s actions and estimated physical properties and uses these extracted forces for predictions. We show the advantages of using physical laws together with deep learning by evaluating it against two baseline models that automatically discover features from the data without such a knowledge. We evaluate our model abilities to extract physical properties and to generalize to unseen trajectories in two games with a shooting mechanism. We also evaluate our model capabilities to transfer learned knowledge from a 2D game for predictions in a 3D game with a similar physics. We show that by using physical laws together with deep learning we achieve a better human-interpretability of learned physical properties, transfer of knowledge to a game with similar physics and very accurate predictions for previously unseen data.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep LearningPredictionTrajectory PredictionSimilar Papers 제목 키워드 기반
History-informed Lagrangian Neural Networks
Forecasting the long-horizon evolution of mechanical systems from position-only observations is a pivotal yet difficult task, as hidden velocities and trajectory-specific physical properties must be inferred simultaneous…
ExPhy: A Benchmark for Explicit Physical Property Learning in Multi-Object Trajectory Forecasting
Understanding object dynamics requires not only predicting future trajectories but also examining whether a model captures the physical properties that govern motion. However, existing benchmarks rarely expose object-lev…
Trajectory ForecastingClass-Aware Attention for Multimodal Trajectory Prediction
Predicting the possible future trajectories of the surrounding dynamic agents is an essential requirement in autonomous driving. These trajectories mainly depend on the surrounding static environment, as well as the past…
Autonomous DrivingPredictionTrajectory PredictionGo with the Flow: Perception-refined Physics Simulation
For many of the physical phenomena around us, we have developed sophisticated models explaining their behavior. Nevertheless, inferring specifics from visual observations is challenging due to the high number of causally…
Bounce and Learn: Modeling Scene Dynamics with Real-World Bounces
We introduce an approach to model surface properties governing bounces in everyday scenes. Our model learns end-to-end, starting from sensor inputs, to predict post-bounce trajectories and infer two underlying physical p…