paper-with-me

홈 › Papers

Model Predictive Simulation Using Structured Graphical Models and Transformers

2024-06-28 · Xinghua Lou, Meet Dave, Shrinu Kushagra, Miguel Lazaro-Gredilla, Kevin Murphy

We propose an approach to simulating trajectories of multiple interacting agents (road users) based on transformers and probabilistic graphical models (PGMs), and apply it to the Waymo SimAgents challenge. The transformer baseline is based on the MTR model, which predicts multiple future trajectories conditioned on the past trajectories and static road layout features. We then improve upon these generated trajectories using a PGM, which contains factors which encode prior knowledge, such as a preference for smooth trajectories, and avoidance of collisions with static obstacles and other moving agents. We perform (approximate) MAP inference in this PGM using the Gauss-Newton method. Finally we sample $K=32$ trajectories for each of the $N \sim 100$ agents for the next $T=8 \Delta$ time steps, where $\Delta=10$ is the sampling rate per second. Following the Model Predictive Control (MPC) paradigm, we only return the first element of our forecasted trajectories at each step, and then we replan, so that the simulation can constantly adapt to its changing environment. We therefore call our approach "Model Predictive Simulation" or MPS. We show that MPS improves upon the MTR baseline, especially in safety critical metrics such as collision rate. Furthermore, our approach is compatible with any underlying forecasting model, and does not require extra training, so we believe it is a valuable contribution to the community.

📄 PDF Abstract BibTeX arXiv:2406.19635

Code (0)

등록된 구현이 없습니다.

Tasks

Model Predictive Control

Methods 이 논문이 사용한 방법론

PGM A regularization criterion that, differently from dropout and its variants, is deterministic rather than random. It grounds on the…

Similar Papers 제목 키워드 기반

Cliqueformer: Model-Based Optimization with Structured Transformers

2024-10-17 · Jakub Grudzien Kuba, Pieter Abbeel, Sergey Levine

Large neural networks excel at prediction tasks, but their application to design problems, such as protein engineering or materials discovery, requires solving offline model-based optimization (MBO) problems. While predi…

model

World Machine: Towards Generative World Modeling for Time-Series

2026-05-21 · Elton Cardoso do Nascimento, Alexandre da Silva Simões, Esther Luna Colombini, Ricardo Ribeiro Gudwin 외 arxiv

World models represent a paradigm shift in generative AI, pursuing predictive understanding and controllable simulation of environments in a structured and generalizable way. We present World Machine, a generative world-…

Divide-and-Conquer Predictive Coding: a structured Bayesian inference algorithm

2024-08-11 · Eli Sennesh, Hao Wu, Tommaso Salvatori

Unexpected stimuli induce "error" or "surprise" signals in the brain. The theory of predictive coding promises to explain these observations in terms of Bayesian inference by suggesting that the cortex implements variati…

Bayesian InferenceVariational Inference

Efficient Mixture of Geographical Species for On Device Wildlife Monitoring

2025-04-11 · Emmanuel Azuh Mensah, Joban Mand, Yueheng Ou, Min Jang 외

Efficient on-device models have become attractive for near-sensor insight generation, of particular interest to the ecological conservation community. For this reason, deep learning researchers are proposing more approac…

Hinge-loss Markov Random Fields: Convex Inference for Structured Prediction

2013-09-26 · Stephen Bach, Bert Huang, Ben London, Lise Getoor

Graphical models for structured domains are powerful tools, but the computational complexities of combinatorial prediction spaces can force restrictions on models, or require approximate inference in order to be tractabl…

Structured Prediction