Energy-based Potential Games for Joint Motion Forecasting and Control
This work uses game theory as a mathematical framework to address interaction modeling in multi-agent motion forecasting and control. Despite its interpretability, applying game theory to real-world robotics, like automated driving, faces challenges such as unknown game parameters. To tackle these, we establish a connection between differential games, optimal control, and energy-based models, demonstrating how existing approaches can be unified under our proposed Energy-based Potential Game formulation. Building upon this, we introduce a new end-to-end learning application that combines neural networks for game-parameter inference with a differentiable game-theoretic optimization layer, acting as an inductive bias. The analysis provides empirical evidence that the game-theoretic layer adds interpretability and improves the predictive performance of various neural network backbones using two simulations and two real-world driving datasets.
Code (1)
Tasks
Inductive BiasMotion ForecastingSimilar Papers 제목 키워드 기반
FutureNet-LOF: Joint Trajectory Prediction and Lane Occupancy Field Prediction with Future Context Encoding
Most prior motion prediction endeavors in autonomous driving have inadequately encoded future scenarios, leading to predictions that may fail to accurately capture the diverse movements of agents (e.g., vehicles or pedes…
Autonomous DrivingMotion Forecastingmotion predictionPrediction+1SoMoFormer: Multi-Person Pose Forecasting with Transformers
Human pose forecasting is a challenging problem involving complex human body motion and posture dynamics. In cases that there are multiple people in the environment, one's motion may also be influenced by the motion and …
Human Pose Forecastingmotion predictionMulti-Person Pose forecastingTime Series AnalysisEfficient ConvNet-Based Marker-Less Motion Capture in General Scenes With a Low Number of Cameras
We present a novel method for accurate marker-less capture of articulated skeleton motion of several subjects in general scenes, indoors and outdoors, even from input filmed with as few as two cameras. Our approach unite…
Pose EstimationLarge Scale Interactive Motion Forecasting for Autonomous Driving : The Waymo Open Motion Dataset
As autonomous driving systems mature, motion forecasting has received increasing attention as a critical requirement for planning. Of particular importance are interactive situations such as merges, unprotected turns, et…
Autonomous DrivingMotion ForecastingMotion PlanningLarge Scale Interactive Motion Forecasting for Autonomous Driving: The Waymo Open Motion Dataset
As autonomous driving systems mature, motion forecasting has received increasing attention as a critical requirement for planning. Of particular importance are interactive situations such as merges, unprotected turns…
Autonomous DrivingMotion ForecastingMotion Planning