EventSplat: 3D Gaussian Splatting from Moving Event Cameras for Real-time Rendering
We introduce a method for using event camera data in novel view synthesis via Gaussian Splatting. Event cameras offer exceptional temporal resolution and a high dynamic range. Leveraging these capabilities allows us to effectively address the novel view synthesis challenge in the presence of fast camera motion. For initialization of the optimization process, our approach uses prior knowledge encoded in an event-to-video model. We also use spline interpolation for obtaining high quality poses along the event camera trajectory. This enhances the reconstruction quality from fast-moving cameras while overcoming the computational limitations traditionally associated with event-based Neural Radiance Field (NeRF) methods. Our experimental evaluation demonstrates that our results achieve higher visual fidelity and better performance than existing event-based NeRF approaches while being an order of magnitude faster to render.
Code (0)
등록된 구현이 없습니다.
Tasks
NeRFNovel View SynthesisSimilar Papers 제목 키워드 기반
Event-guided 3D Gaussian Splatting for Dynamic Human and Scene Reconstruction
Reconstructing dynamic humans together with static scenes from monocular videos remains difficult, especially under fast motion, where RGB frames suffer from motion blur. Event cameras exhibit distinct advantages, e.g., …
Ev-GS: Event-based Gaussian splatting for Efficient and Accurate Radiance Field Rendering
Computational neuromorphic imaging (CNI) with event cameras offers advantages such as minimal motion blur and enhanced dynamic range, compared to conventional frame-based methods. Existing event-based radiance field rend…
Novel View SynthesisEvaGaussians: Event Stream Assisted Gaussian Splatting from Blurry Images
3D Gaussian Splatting (3D-GS) has demonstrated exceptional capabilities in 3D scene reconstruction and novel view synthesis. However, its training heavily depends on high-quality, sharp images and accurate camera poses. …
3D Scene ReconstructionDeblurringNovel View SynthesisPersistGS: Differentiable Physics for Object Permanence in 4D Gaussian Splatting
Dynamic 3D Gaussian Splatting (3DGS) methods reconstruct time-varying scenes from synchronized multi-camera video using photometric supervision. When a moving object becomes fully occluded from all training cameras, this…
GS-EVT: Cross-Modal Event Camera Tracking based on Gaussian Splatting
Reliable self-localization is a foundational skill for many intelligent mobile platforms. This paper explores the use of event cameras for motion tracking thereby providing a solution with inherent robustness under diffi…
Camera Pose EstimationEvent-based visionNovel View SynthesisPose Tracking