paper-with-me

홈 › Papers

XScale-NVS: Cross-Scale Novel View Synthesis with Hash Featurized Manifold

2024-03-28 · CVPR 2024 1 · Guangyu Wang, Jinzhi Zhang, Fan Wang, Ruqi Huang, Lu Fang

We propose XScale-NVS for high-fidelity cross-scale novel view synthesis of real-world large-scale scenes. Existing representations based on explicit surface suffer from discretization resolution or UV distortion, while implicit volumetric representations lack scalability for large scenes due to the dispersed weight distribution and surface ambiguity. In light of the above challenges, we introduce hash featurized manifold, a novel hash-based featurization coupled with a deferred neural rendering framework. This approach fully unlocks the expressivity of the representation by explicitly concentrating the hash entries on the 2D manifold, thus effectively representing highly detailed contents independent of the discretization resolution. We also introduce a novel dataset, namely GigaNVS, to benchmark cross-scale, high-resolution novel view synthesis of realworld large-scale scenes. Our method significantly outperforms competing baselines on various real-world scenes, yielding an average LPIPS that is 40% lower than prior state-of-the-art on the challenging GigaNVS benchmark. Please see our project page at: xscalenvs.github.io.

📄 PDF Abstract BibTeX arXiv:2403.19517

Code (0)

등록된 구현이 없습니다.

Tasks

Neural RenderingNovel View Synthesis

Similar Papers 제목 키워드 기반

Texture Synthesis Guided Deep Hashing for Texture Image Retrieval

2018-11-04 · Ayan Kumar Bhunia, Perla Sai Raj Kishore, Pranay Mukherjee, Abhirup Das 외

With the large-scale explosion of images and videos over the internet, efficient hashing methods have been developed to facilitate memory and time efficient retrieval of similar images. However, none of the existing work…

Data AugmentationDeep HashingImage RetrievalRetrieval+2

Semi-supervised Hashing for Semi-Paired Cross-View Retrieval

2018-06-19 · Jun Yu, Xiao-Jun Wu, Josef Kittler

Recently, hashing techniques have gained importance in large-scale retrieval tasks because of their retrieval speed. Most of the existing cross-view frameworks assume that data are well paired. However, the fully-paired …

Retrieval

Discriminative Cross-View Binary Representation Learning

2018-04-04 · Liu Liu, Hairong Qi

Learning compact representation is vital and challenging for large scale multimedia data. Cross-view/cross-modal hashing for effective binary representation learning has received significant attention with exponentially …

Image RetrievalQuantizationRepresentation LearningRetrieval

Semantics-Preserving Hashing for Cross-View Retrieval

2015-06-01 · CVPR 2015 6 · Zijia Lin, Guiguang Ding, Mingqing Hu, Jian-Min Wang

With benefits of low storage costs and high query speeds, hashing methods are widely researched for efficiently retrieving large-scale data, which commonly contains multiple views, e.g. a news report with images, videos …

Retrieval

Collective Matrix Factorization Hashing for Multimodal Data

2014-06-01 · CVPR 2014 6 · Guiguang Ding, Yuchen Guo, Jile Zhou

Nearest neighbor search methods based on hashing have attracted considerable attention for effective and efficient large-scale similarity search in computer vision and information retrieval community. In this paper, we s…

Information RetrievalRetrieval