paper-with-me

홈 › Papers

RHINO: Regularizing the Hash-based Implicit Neural Representation

2023-09-22 · Hao Zhu, Fengyi Liu, Qi Zhang, Xun Cao, Zhan Ma

The use of Implicit Neural Representation (INR) through a hash-table has demonstrated impressive effectiveness and efficiency in characterizing intricate signals. However, current state-of-the-art methods exhibit insufficient regularization, often yielding unreliable and noisy results during interpolations. We find that this issue stems from broken gradient flow between input coordinates and indexed hash-keys, where the chain rule attempts to model discrete hash-keys, rather than the continuous coordinates. To tackle this concern, we introduce RHINO, in which a continuous analytical function is incorporated to facilitate regularization by connecting the input coordinate and the network additionally without modifying the architecture of current hash-based INRs. This connection ensures a seamless backpropagation of gradients from the network's output back to the input coordinates, thereby enhancing regularization. Our experimental results not only showcase the broadened regularization capability across different hash-based INRs like DINER and Instant NGP, but also across a variety of tasks such as image fitting, representation of signed distance functions, and optimization of 5D static / 6D dynamic neural radiance fields. Notably, RHINO outperforms current state-of-the-art techniques in both quality and speed, affirming its superiority.

📄 PDF Abstract BibTeX arXiv:2309.12642

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Regularizing Deep Hashing Networks Using GAN Generated Fake Images

2018-03-26 · Libing Geng, Yan Pan, Jikai Chen, Hanjiang Lai

Recently, deep-networks-based hashing (deep hashing) has become a leading approach for large-scale image retrieval. It aims to learn a compact bitwise representation for images via deep networks, so that similar images a…

Deep HashingGenerative Adversarial NetworkImage RetrievalRetrieval

Unsupervised Few-Bits Semantic Hashing with Implicit Topics Modeling

2020-11-01 · Findings of the Association for Computational Linguistics 2020 · Fanghua Ye, Jarana Manotumruksa, Emine Yilmaz

Semantic hashing is a powerful paradigm for representing texts as compact binary hash codes. The explosion of short text data has spurred the demand of few-bits hashing. However, the performance of existing semantic hash…

Find Rhinos without Finding Rhinos: Active Learning with Multimodal Imagery of South African Rhino Habitats

2024-09-26 · Lucia Gordon, Nikhil Behari, Samuel Collier, Elizabeth Bondi-Kelly 외

Much of Earth's charismatic megafauna is endangered by human activities, particularly the rhino, which is at risk of extinction due to the poaching crisis in Africa. Monitoring rhinos' movement is crucial to their protec…

Active Learning

An Evolutionary Game Theoretic Model of Rhino Horn Devaluation

2017-12-20 · Nikoleta E. Glynatsi, Vincent Knight, Tamsin E. Lee

Rhino populations are at a critical level due to the demand for rhino horn and the subsequent poaching. Wildlife managers attempt to secure rhinos with approaches to devalue the horn, the most common of which is dehornin…

Auto-Parallelizing Large Models with Rhino: A Systematic Approach on Production AI Platform

2023-02-16 · Shiwei Zhang, Lansong Diao, Siyu Wang, Zongyan Cao 외

We present Rhino, a system for accelerating tensor programs with automatic parallelization on AI platform for real production environment. It transforms a tensor program written for a single device into an equivalent dis…