paper-with-me

홈 › Papers

TK-Planes: Tiered K-Planes with High Dimensional Feature Vectors for Dynamic UAV-based Scenes

2024-05-04 · Christopher Maxey, Jaehoon Choi, Yonghan Lee, Hyungtae Lee, Dinesh Manocha, Heesung Kwon

In this paper, we present a new approach to bridge the domain gap between synthetic and real-world data for unmanned aerial vehicle (UAV)-based perception. Our formulation is designed for dynamic scenes, consisting of small moving objects or human actions. We propose an extension of K-Planes Neural Radiance Field (NeRF), wherein our algorithm stores a set of tiered feature vectors. The tiered feature vectors are generated to effectively model conceptual information about a scene as well as an image decoder that transforms output feature maps into RGB images. Our technique leverages the information amongst both static and dynamic objects within a scene and is able to capture salient scene attributes of high altitude videos. We evaluate its performance on challenging datasets, including Okutama Action and UG2, and observe considerable improvement in accuracy over state of the art neural rendering methods.

📄 PDF Abstract BibTeX arXiv:2405.02762

Code (0)

등록된 구현이 없습니다.

Tasks

DecoderNeRFNeural Rendering

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

K-Planes: Explicit Radiance Fields in Space, Time, and Appearance

2023-01-24 · CVPR 2023 1 · Sara Fridovich-Keil, Giacomo Meanti, Frederik Warburg, Benjamin Recht 외

We introduce k-planes, a white-box model for radiance fields in arbitrary dimensions. Our model uses d choose 2 planes to represent a d-dimensional scene, providing a seamless way to go from static (d=3) to dynamic (d=4)…

DecoderNovel View Synthesis

Slicing the hypercube is not easy

2021-02-10 · Gal Yehuda, Amir Yehudayoff

We prove that at least $\Omega(n^{0.51})$ hyperplanes are needed to slice all edges of the $n$-dimensional hypercube. We provide a couple of applications: lower bounds on the computational complexity of parity, and a low…

WavePlanes: Compact Hex Planes for Dynamic Novel View Synthesis

2023-12-03 · Adrian Azzarelli, Nantheera Anantrasirichai, David R Bull

Dynamic Novel View Synthesis (Dynamic NVS) enhances NVS technologies to model moving 3-D scenes. However, current methods are resource intensive and challenging to compress. To address this, we present WavePlanes, a fast…

Novel View Synthesis

Learning Anchor Planes for Classification

2011-12-01 · NeurIPS 2011 12 · Ziming Zhang, Lubor Ladicky, Philip Torr, Amir Saffari

Local Coordinate Coding (LCC) [18] is a method for modeling functions of data lying on non-linear manifolds. It provides a set of anchor points which form a local coordinate system, such that each data point on the manif…

ClassificationGeneral Classification

Freeplane: Unlocking Free Lunch in Triplane-Based Sparse-View Reconstruction Models

2024-06-02 · Wenqiang Sun, Zhengyi Wang, Shuo Chen, Yikai Wang 외

Creating 3D assets from single-view images is a complex task that demands a deep understanding of the world. Recently, feed-forward 3D generative models have made significant progress by training large reconstruction mod…

3D geometry