XScale-NVS: Cross-Scale Novel View Synthesis with Hash Featurized Manifold
We propose XScale-NVS for high-fidelity cross-scale novel view synthesis of real-world large-scale scenes. Existing representations based on explicit surface suffer from discretization resolution or UV distortion, while implicit volumetric representations lack scalability for large scenes due to the dispersed weight distribution and surface ambiguity. In light of the above challenges, we introduce hash featurized manifold, a novel hash-based featurization coupled with a deferred neural rendering framework. This approach fully unlocks the expressivity of the representation by explicitly concentrating the hash entries on the 2D manifold, thus effectively representing highly detailed contents independent of the discretization resolution. We also introduce a novel dataset, namely GigaNVS, to benchmark cross-scale, high-resolution novel view synthesis of realworld large-scale scenes. Our method significantly outperforms competing baselines on various real-world scenes, yielding an average LPIPS that is 40% lower than prior state-of-the-art on the challenging GigaNVS benchmark. Please see our project page at: xscalenvs.github.io.
Code (0)
등록된 구현이 없습니다.
Tasks
Neural RenderingNovel View SynthesisSimilar Papers 제목 키워드 기반
Texture Synthesis Guided Deep Hashing for Texture Image Retrieval
With the large-scale explosion of images and videos over the internet, efficient hashing methods have been developed to facilitate memory and time efficient retrieval of similar images. However, none of the existing work…
Data AugmentationDeep HashingImage RetrievalRetrieval+2Semi-supervised Hashing for Semi-Paired Cross-View Retrieval
Recently, hashing techniques have gained importance in large-scale retrieval tasks because of their retrieval speed. Most of the existing cross-view frameworks assume that data are well paired. However, the fully-paired …
RetrievalDiscriminative Cross-View Binary Representation Learning
Learning compact representation is vital and challenging for large scale multimedia data. Cross-view/cross-modal hashing for effective binary representation learning has received significant attention with exponentially …
Image RetrievalQuantizationRepresentation LearningRetrievalSemantics-Preserving Hashing for Cross-View Retrieval
With benefits of low storage costs and high query speeds, hashing methods are widely researched for efficiently retrieving large-scale data, which commonly contains multiple views, e.g. a news report with images, videos …
RetrievalCollective Matrix Factorization Hashing for Multimodal Data
Nearest neighbor search methods based on hashing have attracted considerable attention for effective and efficient large-scale similarity search in computer vision and information retrieval community. In this paper, we s…
Information RetrievalRetrieval