Adaptive Time-step Training for Enhancing Spike-Based Neural Radiance Fields
Spiking Neural Networks (SNNs) provide an energy-efficient computing paradigm for neural rendering, but existing spike-based Neural Radiance Field (NeRF) models usually use a fixed inference time step for all scenes. This fixed temporal budget is inefficient because NeRF follows a scene-specific training paradigm, and different scenes require different temporal capacities to preserve rendering quality. This paper proposes Pretraining-based Adaptive Time-step Adjustment (PATA), a scene-wise adaptive time-step training framework for spike-based NeRF. PATA parameterizes the target inference time step as a trainable variable and optimizes it through a two-stage training process. A hybrid input mode strengthens early time-step outputs, while full-step soft supervision, smoothed rendering loss, and temporal-budget loss jointly maintain rendering fidelity and reduce temporal computation. The learned target time step is shared by all ray samples within a scene, preserving the parallel rendering structure of NeRF. Experiments on INGP-NeRF and TensoRF backbones across Synthetic-NeRF, Mip-NeRF 360, and LLFF show that PATA consistently reduces inference cost while maintaining competitive rendering quality. PATA reduces the estimated inference energy by up to 57.57\% on INGP-NeRF and 68.90\% on TensoRF, demonstrating its effectiveness across different neural rendering representations.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
NeuSort: An Automatic Adaptive Spike Sorting Approach with Neuromorphic Models
Objective. Spike sorting, a critical step in neural data processing, aims to classify spiking events from single electrode recordings based on different waveforms. This study aims to develop a novel online spike sorter, …
Spike SortingTemplate MatchingFrom Silicon to Spikes: System-Wide Efficiency Gains via Exact Event-Driven Training in Neuromorphic Computing
Spiking neural networks (SNNs) promise orders-of-magnitude efficiency gains by communicating with sparse, event-driven spikes rather than dense numerical activations. However, most training pipelines either rely on surro…
Adaptive Calibration: A Unified Conversion Framework of Spiking Neural Network
Spiking Neural Networks (SNNs) are seen as an energy-efficient alternative to traditional Artificial Neural Networks (ANNs), but the performance gap remains a challenge. While this gap is narrowing through ANN-to-SNN con…
object-detectionObject DetectionAdaptive Calibration: A Unified Conversion Framework of Spiking Neural Networks
Spiking Neural Networks (SNNs) have emerged as a promising energy-efficient alternative to traditional Artificial Neural Networks (ANNs). Despite this, bridging the performance gap with ANNs in practical scenarios remain…
Event-based visionobject-detectionObject DetectionIML-Spikeformer: Input-aware Multi-Level Spiking Transformer for Speech Processing
Spiking Neural Networks (SNNs), inspired by biological neural mechanisms, represent a promising neuromorphic computing paradigm that offers energy-efficient alternatives to traditional Artificial Neural Networks (ANNs). …