paper-with-me

홈 › Papers

Gaussian Splatting in Style

2024-03-13 · Abhishek Saroha, Mariia Gladkova, Cecilia Curreli, Dominik Muhle, Tarun Yenamandra, Daniel Cremers

3D scene stylization extends the work of neural style transfer to 3D. A vital challenge in this problem is to maintain the uniformity of the stylized appearance across multiple views. A vast majority of the previous works achieve this by training a 3D model for every stylized image and a set of multi-view images. In contrast, we propose a novel architecture trained on a collection of style images that, at test time, produces real time high-quality stylized novel views. We choose the underlying 3D scene representation for our model as 3D Gaussian splatting. We take the 3D Gaussians and process them using a multi-resolution hash grid and a tiny MLP to obtain stylized views. The MLP is conditioned on different style codes for generalization to different styles during test time. The explicit nature of 3D Gaussians gives us inherent advantages over NeRF-based methods, including geometric consistency and a fast training and rendering regime. This enables our method to be useful for various practical use cases, such as augmented or virtual reality. We demonstrate that our method achieves state-of-the-art performance with superior visual quality on various indoor and outdoor real-world data.

📄 PDF Abstract BibTeX arXiv:2403.08498

Code (0)

등록된 구현이 없습니다.

Tasks

NeRFStyle Transfer

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

G-Style: Stylized Gaussian Splatting

2024-08-28 · Áron Samuel Kovács, Pedro Hermosilla, Renata G. Raidou

We introduce G-Style, a novel algorithm designed to transfer the style of an image onto a 3D scene represented using Gaussian Splatting. Gaussian Splatting is a powerful 3D representation for novel view synthesis, as -- …

Novel View Synthesis

4DStyleGaussian: Zero-shot 4D Style Transfer with Gaussian Splatting

2024-10-14 · Wanlin Liang, Hongbin Xu, Weitao Chen, Feng Xiao 외

3D neural style transfer has gained significant attention for its potential to provide user-friendly stylization with spatial consistency. However, existing 3D style transfer methods often fall short in terms of inferenc…

Style Transfer

SGSST: Scaling Gaussian Splatting StyleTransfer

2024-12-04 · Bruno Galerne, Jianling Wang, Lara Raad, Jean-Michel Morel

Applying style transfer to a full 3D environment is a challenging task that has seen many developments since the advent of neural rendering. 3D Gaussian splatting (3DGS) has recently pushed further many limits of neural …

3DGSNeural RenderingStyle Transfer

SGSST: Scaling Gaussian Splatting Style Transfer

2025-01-01 · CVPR 2025 1 · Bruno Galerne, Jianling Wang, Lara Raad, Jean-Michel Morel

Applying style transfer to a full 3D environment is a challenging task that has seen many developments since the advent of neural rendering. 3D Gaussian splatting (3DGS) has recently pushed further many limits of neu…

3DGSNeural RenderingStyle Transfer

InstantStyleGaussian: Efficient Art Style Transfer with 3D Gaussian Splatting

2024-08-08 · Xin-Yi Yu, Jun-Xin Yu, Li-Bo Zhou, Yan Wei 외

We present InstantStyleGaussian, an innovative 3D style transfer method based on the 3D Gaussian Splatting (3DGS) scene representation. By inputting a target-style image, it quickly generates new 3D GS scenes. Our method…

3DGSStyle Transfer