paper-with-me

홈 › Papers

WayveScenes101: A Dataset and Benchmark for Novel View Synthesis in Autonomous Driving

2024-07-11 · Jannik Zürn, Paul Gladkov, Sofía Dudas, Fergal Cotter, Sofi Toteva, Jamie Shotton, Vasiliki Simaiaki, Nikhil Mohan

We present WayveScenes101, a dataset designed to help the community advance the state of the art in novel view synthesis that focuses on challenging driving scenes containing many dynamic and deformable elements with changing geometry and texture. The dataset comprises 101 driving scenes across a wide range of environmental conditions and driving scenarios. The dataset is designed for benchmarking reconstructions on in-the-wild driving scenes, with many inherent challenges for scene reconstruction methods including image glare, rapid exposure changes, and highly dynamic scenes with significant occlusion. Along with the raw images, we include COLMAP-derived camera poses in standard data formats. We propose an evaluation protocol for evaluating models on held-out camera views that are off-axis from the training views, specifically testing the generalisation capabilities of methods. Finally, we provide detailed metadata for all scenes, including weather, time of day, and traffic conditions, to allow for a detailed model performance breakdown across scene characteristics. Dataset and code are available at https://github.com/wayveai/wayve_scenes.

📄 PDF Abstract BibTeX arXiv:2407.08280

Code (1)

wayveai/wayve_scenes 공식 구현 pytorch

Tasks

Autonomous DrivingBenchmarkingNovel View Synthesis

Similar Papers 제목 키워드 기반

StandardE2E: A Unified Framework for End-to-End Autonomous Driving Datasets

2026-06-02 · Stepan Konev arxiv

Autonomous driving has shifted from modular perception-prediction-planning stacks toward end-to-end (E2E) models that map sensor inputs directly to vehicle control, often regularized by auxiliary tasks such as 3D detecti…

Autonomous DrivingMotion Forecasting

Query3D: LLM-Powered Open-Vocabulary Scene Segmentation with Language Embedded 3D Gaussian

2024-08-07 · Amirhosein Chahe, Lifeng Zhou

This paper introduces a novel method for open-vocabulary 3D scene querying in autonomous driving by combining Language Embedded 3D Gaussians with Large Language Models (LLMs). We propose utilizing LLMs to generate both c…

Autonomous Drivingobject-detectionObject DetectionOpen Vocabulary Object Detection+2

XLD: A Cross-Lane Dataset for Benchmarking Novel Driving View Synthesis

2024-06-26 · Hao Li, Chenming Wu, Ming Yuan, Yan Zhang 외

Comprehensive testing of autonomous systems through simulation is essential to ensure the safety of autonomous driving vehicles. This requires the generation of safety-critical scenarios that extend beyond the limitation…

Autonomous DrivingBenchmarkingNovel View Synthesis

VR-Drive: Viewpoint-Robust End-to-End Driving with Feed-Forward 3D Gaussian Splatting

2025-10-27 · Hoonhee Cho, Jae-Young Kang, Giwon Lee, Hyemin Yang 외 arxiv

End-to-end autonomous driving (E2E-AD) has emerged as a promising paradigm that unifies perception, prediction, and planning into a holistic, data-driven framework. However, achieving robustness to varying camera viewpoi…

Autonomous Driving

MuSHRoom: Multi-Sensor Hybrid Room Dataset for Joint 3D Reconstruction and Novel View Synthesis

2023-11-05 · Xuqian Ren, Wenjia Wang, Dingding Cai, Tuuli Tuominen 외

Metaverse technologies demand accurate, real-time, and immersive modeling on consumer-grade hardware for both non-human perception (e.g., drone/robot/autonomous car navigation) and immersive technologies like AR/VR, requ…

3D ReconstructionNovel View Synthesis