paper-with-me

홈 › Papers

Scaling Up Occupancy-centric Driving Scene Generation: Dataset and Method

2025-10-27 · Bohan Li, Xin Jin, Hu Zhu, Hongsi Liu, Ruikai Li, Jiazhe Guo, Kaiwen Cai, Chao Ma, Yueming Jin, Hao Zhao, Xiaokang Yang, Wenjun Zeng arxiv

Driving scene generation is a critical domain for autonomous driving, enabling downstream applications, including perception and planning evaluation. Occupancy-centric methods have recently achieved state-of-the-art results by offering consistent conditioning across frames and modalities; however, their performance heavily depends on annotated occupancy data, which still remains scarce. To overcome this limitation, we curate Nuplan-Occ, the largest semantic occupancy dataset to date, constructed from the widely used Nuplan benchmark. Its scale and diversity facilitate not only large-scale generative modeling but also autonomous driving downstream applications. Based on this dataset, we develop a unified framework that jointly synthesizes high-quality semantic occupancy, multi-view videos, and LiDAR point clouds. Our approach incorporates a spatio-temporal disentangled architecture to support high-fidelity spatial expansion and temporal forecasting of 4D dynamic occupancy. To bridge modal gaps, we further propose two novel techniques: a Gaussian splatting-based sparse point map rendering strategy that enhances multi-view video generation, and a sensor-aware embedding strategy that explicitly models LiDAR sensor properties for realistic multi-LiDAR simulation. Extensive experiments demonstrate that our method achieves superior generation fidelity and scalability compared to existing approaches, and validates its practical value in downstream tasks. Repo: https://github.com/Arlo0o/UniScene-Unified-Occupancy-centric-Driving-Scene-Generation/tree/v2

📄 PDF Abstract BibTeX arXiv:2510.22973

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous DrivingScene GenerationVideo GenerationPoint Clouds

Similar Papers 제목 키워드 기반

UniScene: Unified Occupancy-centric Driving Scene Generation

2024-12-06 · CVPR 2025 1 · Bohan Li, Jiazhe Guo, Hongsi Liu, Yingshuang Zou 외

Generating high-fidelity, controllable, and annotated training data is critical for autonomous driving. Existing methods typically generate a single data form directly from a coarse scene layout, which not only fails to …

Autonomous DrivingScene Generation

AnyScene: Towards Highly Controllable Driving Scene Generation at Anywhere and Beyond

2026-05-25 · Haiming Zhang, Junfei Zhou, Feng Jiang, Jingzhong Li 외 arxiv

Generating high-fidelity and controllable synthetic data is critical for advancing end-to-end autonomous driving, particularly for addressing the long tail of rare safety-critical scenarios. Existing occupancy-guided met…

Autonomous Driving3D ReconstructionScene GenerationVideo Generation

Driving in the Occupancy World: Vision-Centric 4D Occupancy Forecasting and Planning via World Models for Autonomous Driving

2024-08-26 · Yu Yang, Jianbiao Mei, Yukai Ma, Siliang Du 외

World models envision potential future states based on various ego actions. They embed extensive knowledge about the driving environment, facilitating safe and scalable autonomous driving. Most existing methods primarily…

Autonomous DrivingDecoder

Towards Flexible 3D Perception: Object-Centric Occupancy Completion Augments 3D Object Detection

2024-12-06 · Chaoda Zheng, Feng Wang, Naiyan Wang, Shuguang Cui 외

While 3D object bounding box (bbox) representation has been widely used in autonomous driving perception, it lacks the ability to capture the precise details of an object's intrinsic geometry. Recently, occupancy has eme…

3D Object DetectionAutonomous DrivingObjectobject-detection+1

GaussianSeed: Hierarchical Gaussian Seeding for High-Resolution 3D Occupancy Prediction

2026-07-22 · Xinzhuo Li, Xianghui Pan, Jiayuan Du, Wei Wei 외 arxiv

Vision-centric 3D occupancy prediction provides dense scene representations essential for autonomous driving and robotic navigation, yet existing methods struggle to scale to high voxel resolutions due to prohibitive com…

Autonomous Driving