paper-with-me

홈 › Papers

Incremental Multi-Scene Modeling via Continual Neural Graphics Primitives

2024-11-29 · Prajwal Singh, Ashish Tiwari, Gautam Vashishtha, Shanmuganathan Raman

Neural radiance fields (NeRF) have revolutionized photorealistic rendering of novel views for 3D scenes. Despite their growing popularity and efficiency as 3D resources, NeRFs face scalability challenges due to the need for separate models per scene and the cumulative increase in training time for multiple scenes. The potential for incrementally encoding multiple 3D scenes into a single NeRF model remains largely unexplored. To address this, we introduce Continual-Neural Graphics Primitives (C-NGP), a novel continual learning framework that integrates multiple scenes incrementally into a single neural radiance field. Using a generative replay approach, C-NGP adapts to new scenes without requiring access to old data. We demonstrate that C-NGP can accommodate multiple scenes without increasing the parameter count, producing high-quality novel-view renderings on synthetic and real datasets. Notably, C-NGP models all $8$ scenes from the Real-LLFF dataset together, with only a $2.2\%$ drop in PSNR compared to vanilla NeRF, which models each scene independently. Further, C-NGP allows multiple style edits in the same network.

📄 PDF Abstract BibTeX arXiv:2411.19903

Code (0)

등록된 구현이 없습니다.

Tasks

Continual LearningNeRF

Similar Papers 제목 키워드 기반

Evaluating Continual Learning Algorithms by Generating 3D Virtual Environments

2021-09-16 · Enrico Meloni, Alessandro Betti, Lapo Faggi, Simone Marullo 외

Continual learning refers to the ability of humans and animals to incrementally learn over time in a given environment. Trying to simulate this learning process in machines is a challenging task, also due to the inherent…

Continual Learning

Adaptive Visual Scene Understanding: Incremental Scene Graph Generation

2023-10-02 · Naitik Khandelwal, Xiao Liu, Mengmi Zhang

Scene graph generation (SGG) analyzes images to extract meaningful information about objects and their relationships. In the dynamic visual world, it is crucial for AI systems to continuously detect new objects and estab…

BenchmarkingContinual LearningGraph Generationobject-detection+3

Video Domain Incremental Learning for Human Action Recognition in Home Environments

2024-12-22 · Yuanda Hu, Xing Liu, Meiying Li, Yate Ge 외

It is significantly challenging to recognize daily human actions in homes due to the diversity and dynamic changes in unconstrained home environments. It spurs the need to continually adapt to various users and scenes. F…

Action Recognitionclass-incremental learningClass Incremental LearningContinual Learning+3

A Continual Deepfake Detection Benchmark: Dataset, Methods, and Essentials

2022-05-11 · Chuqiao Li, Zhiwu Huang, Danda Pani Paudel, Yabin Wang 외

There have been emerging a number of benchmarks and techniques for the detection of deepfakes. However, very few works study the detection of incrementally appearing deepfakes in the real-world scenarios. To simulate the…

Continual LearningDeepFake DetectionFace SwappingIncremental Learning

Incremental Abstraction in Distributed Probabilistic SLAM Graphs

2021-09-13 · Joseph Ortiz, Talfan Evans, Edgar Sucar, Andrew J. Davison

Scene graphs represent the key components of a scene in a compact and semantically rich way, but are difficult to build during incremental SLAM operation because of the challenges of robustly identifying abstract scene e…