paper-with-me

Papers

Diffusion-Based Generative Models for 3D Occupancy Prediction in Autonomous Driving

2025-05-29 · Yunshen Wang, Yicheng Liu, Tianyuan Yuan, Yucheng Mao, Yingshi Liang, Xiuyu Yang, Honggang Zhang, Hang Zhao

Accurately predicting 3D occupancy grids from visual inputs is critical for autonomous driving, but current discriminative methods struggle with noisy data, incomplete observations, and the complex structures inherent in 3D scenes. In this work, we reframe 3D occupancy prediction as a generative modeling task using diffusion models, which learn the underlying data distribution and incorporate 3D scene priors. This approach enhances prediction consistency, noise robustness, and better handles the intricacies of 3D spatial structures. Our extensive experiments show that diffusion-based generative models outperform state-of-the-art discriminative approaches, delivering more realistic and accurate occupancy predictions, especially in occluded or low-visibility regions. Moreover, the improved predictions significantly benefit downstream planning tasks, highlighting the practical advantages of our method for real-world autonomous driving applications.

📄 PDF Abstract BibTeX arXiv:2505.23115

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous Driving

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

OccSora: 4D Occupancy Generation Models as World Simulators for Autonomous Driving

2024-05-30 · Lening Wang, Wenzhao Zheng, Yilong Ren, Han Jiang 외

Understanding the evolution of 3D scenes is important for effective autonomous driving. While conventional methods mode scene development with the motion of individual instances, world models emerge as a generative frame…

Autonomous DrivingDecision Making

OccGen: Generative Multi-modal 3D Occupancy Prediction for Autonomous Driving

2024-04-23 · Guoqing Wang, Zhongdao Wang, Pin Tang, Jilai Zheng 외

Existing solutions for 3D semantic occupancy prediction typically treat the task as a one-shot 3D voxel-wise segmentation perception problem. These discriminative methods focus on learning the mapping between the inputs …

3D Semantic Occupancy PredictionAutonomous DrivingDenoising

OccLLaMA: An Occupancy-Language-Action Generative World Model for Autonomous Driving

2024-09-05 · Julong Wei, Shanshuai Yuan, Pengfei Li, Qingda Hu 외

The rise of multi-modal large language models(MLLMs) has spurred their applications in autonomous driving. Recent MLLM-based methods perform action by learning a direct mapping from perception to action, neglecting the d…

Autonomous DrivingMotion PlanningQuestion AnsweringVision-Language-Action+1

Self-supervised Multi-future Occupancy Forecasting for Autonomous Driving

2024-07-30 · Bernard Lange, Masha Itkina, Jiachen Li, Mykel J. Kochenderfer

Environment prediction frameworks are critical for the safe navigation of autonomous vehicles (AVs) in dynamic settings. LiDAR-generated occupancy grid maps (L-OGMs) offer a robust bird's-eye view for the scene represent…

Autonomous DrivingAutonomous VehiclesDecoderPrediction

Vision-based 3D occupancy prediction in autonomous driving: a review and outlook

2024-05-04 · Yanan Zhang, Jinqing Zhang, Zengran Wang, Junhao Xu 외

In recent years, autonomous driving has garnered escalating attention for its potential to relieve drivers' burdens and improve driving safety. Vision-based 3D occupancy prediction, which predicts the spatial occupancy s…

Autonomous DrivingPrediction