READ: Large-Scale Neural Scene Rendering for Autonomous Driving
Synthesizing free-view photo-realistic images is an important task in multimedia. With the development of advanced driver assistance systems~(ADAS) and their applications in autonomous vehicles, experimenting with different scenarios becomes a challenge. Although the photo-realistic street scenes can be synthesized by image-to-image translation methods, which cannot produce coherent scenes due to the lack of 3D information. In this paper, a large-scale neural rendering method is proposed to synthesize the autonomous driving scene~(READ), which makes it possible to synthesize large-scale driving scenarios on a PC through a variety of sampling schemes. In order to represent driving scenarios, we propose an {\omega} rendering network to learn neural descriptors from sparse point clouds. Our model can not only synthesize realistic driving scenes but also stitch and edit driving scenes. Experiments show that our model performs well in large-scale driving scenarios.
Code (1)
Tasks
3D Scene ReconstructionAutonomous DrivingAutonomous VehiclesImage-to-Image TranslationNeural RenderingNovel View SynthesisTranslationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
PaReNeRF: Toward Fast Large-scale Dynamic NeRF with Patch-based Reference
With photo-realistic image generation Neural Radiance Field (NeRF) is widely used for large-scale dynamic scene reconstruction as autonomous driving simulator. However large-scale scene reconstruction still suffers f…
Autonomous DrivingDecoderImage GenerationImage Reconstruction+2DGNR: Density-Guided Neural Point Rendering of Large Driving Scenes
Despite the recent success of Neural Radiance Field (NeRF), it is still challenging to render large-scale driving scenes with long trajectories, particularly when the rendering quality and efficiency are in high demand. …
Autonomous DrivingDepth EstimationNeRFNeural RenderingScatterNeRF: Seeing Through Fog with Physically-Based Inverse Neural Rendering
Vision in adverse weather conditions, whether it be snow, rain, or fog is challenging. In these scenarios, scattering and attenuation severly degrades image quality. Handling such inclement weather conditions, however, i…
Autonomous VehiclesInverse RenderingNeural RenderingPocket-SLAM: Rendering-Area-Aware Pruning for Memory-Efficient 3DGS-SLAM
3D Gaussian Splatting (3DGS) has garnered significant attention in Simultaneous Localization and Mapping (SLAM) due to its advances in capturing fine-grained geometry features and synthesizing novel views. For SLAM in la…
Autonomous DrivingDrone-assisted Road Gaussian Splatting with Cross-view Uncertainty
Robust and realistic rendering for large-scale road scenes is essential in autonomous driving simulation. Recently, 3D Gaussian Splatting (3D-GS) has made groundbreaking progress in neural rendering, but the general fide…
Autonomous DrivingNeural RenderingNovel View Synthesis