paper-with-me

홈 › Papers

SuperGaussian: Repurposing Video Models for 3D Super Resolution

2024-06-02 · Yuan Shen, Duygu Ceylan, Paul Guerrero, Zexiang Xu, Niloy J. Mitra, Shenlong Wang, Anna Frühstück

We present a simple, modular, and generic method that upsamples coarse 3D models by adding geometric and appearance details. While generative 3D models now exist, they do not yet match the quality of their counterparts in image and video domains. We demonstrate that it is possible to directly repurpose existing (pretrained) video models for 3D super-resolution and thus sidestep the problem of the shortage of large repositories of high-quality 3D training models. We describe how to repurpose video upsampling models, which are not 3D consistent, and combine them with 3D consolidation to produce 3D-consistent results. As output, we produce high quality Gaussian Splat models, which are object centric and effective. Our method is category agnostic and can be easily incorporated into existing 3D workflows. We evaluate our proposed SuperGaussian on a variety of 3D inputs, which are diverse both in terms of complexity and representation (e.g., Gaussian Splats or NeRFs), and demonstrate that our simple method significantly improves the fidelity of the final 3D models. Check our project website for details: supergaussian.github.io

📄 PDF Abstract BibTeX arXiv:2406.00609

Code (0)

등록된 구현이 없습니다.

Tasks

Super-Resolution

Similar Papers 제목 키워드 기반

COSMOS: Coherent Supergaussian Modeling with Spatial Priors for Sparse-View 3D Splatting

2025-12-17 · Chaeyoung Jeong, Kwangsu Kim arxiv

3D Gaussian Splatting (3DGS) has recently emerged as a promising approach for 3D reconstruction, providing explicit, point-based representations and enabling high-quality real time rendering. However, when trained with s…

3D Reconstruction

SuperGaussians: Enhancing Gaussian Splatting Using Primitives with Spatially Varying Colors

2024-11-28 · Rui Xu, Wenyue Chen, Jiepeng Wang, YuAn Liu 외

Gaussian Splattings demonstrate impressive results in multi-view reconstruction based on Gaussian explicit representations. However, the current Gaussian primitives only have a single view-dependent color and an opacity …

Novel View Synthesis

Repurposing Pre-trained Video Diffusion Models for Event-based Video Interpolation

2024-12-10 · CVPR 2025 1 · Jingxi Chen, Brandon Y. Feng, Haoming Cai, Tianfu Wang 외

Video Frame Interpolation aims to recover realistic missing frames between observed frames, generating a high-frame-rate video from a low-frame-rate video. However, without additional guidance, the large motion between f…

Video Frame Interpolation

Proba-V-ref: Repurposing the Proba-V challenge for reference-aware super resolution

2021-01-25 · Ngoc Long Nguyen, Jérémy Anger, Axel Davy, Pablo Arias 외

The PROBA-V Super-Resolution challenge distributes real low-resolution image series and corresponding high-resolution targets to advance research on Multi-Image Super Resolution (MISR) for satellite images. However, in t…

Image Super-ResolutionSuper-Resolution

Video Repurposing from User Generated Content: A Large-scale Dataset and Benchmark

2024-12-12 · Yongliang Wu, Wenbo Zhu, Jiawang Cao, Yi Lu 외

The demand for producing short-form videos for sharing on social media platforms has experienced significant growth in recent times. Despite notable advancements in the fields of video summarization and highlight detecti…

Highlight DetectionVideo Summarization