paper-with-me

Papers

Node-RF: Learning Generalized Continuous Space-Time Scene Dynamics with Neural ODE-based NeRFs

2026-03-12 · Hiran Sarkar, Liming Kuang, Yordanka Velikova, Benjamin Busam arxiv

Predicting scene dynamics from visual observations is challenging. Existing methods capture dynamics only within observed boundaries failing to extrapolate far beyond the training sequence. Node-RF (Neural ODE-based NeRF) overcomes this limitation by integrating Neural Ordinary Differential Equations (NODEs) with dynamic Neural Radiance Fields (NeRFs), enabling a continuous-time, spatiotemporal representation that generalizes beyond observed trajectories at constant memory cost. From visual input, Node-RF learns an implicit scene state that evolves over time via an ODE solver, propagating feature embeddings via differential calculus. A NeRF-based renderer interprets calculated embeddings to synthesize arbitrary views for long-range extrapolation. Training on multiple motion sequences with shared dynamics allows for generalization to unseen conditions. Our experiments demonstrate that Node-RF can characterize abstract system behavior without explicit model to identify critical points for future predictions.

📄 PDF Abstract BibTeX arXiv:2603.12078

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Multi-Scene Generalized Trajectory Global Graph Solver with Composite Nodes for Multiple Object Tracking

2023-12-14 · Yan Gao, Haojun Xu, Nannan Wang, Jie Li 외

The global multi-object tracking (MOT) system can consider interaction, occlusion, and other ``visual blur'' scenarios to ensure effective object tracking in long videos. Among them, graph-based tracking-by-detection par…

Multi-Object TrackingMultiple Object TrackingObjectObject Tracking

Joint Generative Modeling of Scene Graphs and Images via Diffusion Models

2024-01-02 · Bicheng Xu, Qi Yan, Renjie Liao, Lele Wang 외

In this paper, we present a novel generative task: joint scene graph - image generation. While previous works have explored image generation conditioned on scene graphs or layouts, our task is distinctive and important a…

Graph GenerationImage GenerationScene Graph DetectionScene Graph Generation

DAG Learning from Zero-Inflated Count Data Using Continuous Optimization

2025-12-18 · Noriaki Sato, Marco Scutari, Shuichi Kawano, Rui Yamaguchi 외 arxiv

We address network structure learning from zero-inflated count data by casting each node as a zero-inflated generalized linear model and optimizing a smooth, score-based objective under a directed acyclic graph constrain…

Viewpoint Textual Inversion: Discovering Scene Representations and 3D View Control in 2D Diffusion Models

2023-09-14 · James Burgess, Kuan-Chieh Wang, Serena Yeung-Levy

Text-to-image diffusion models generate impressive and realistic images, but do they learn to represent the 3D world from only 2D supervision? We demonstrate that yes, certain 3D scene representations are encoded in the …

Image GenerationNovel View SynthesisText to Image GenerationText-to-Image Generation

Gradient-based Causal Structure Learning with Normalizing Flow

2020-10-07 · Xiongren Chen

In this paper, we propose a score-based normalizing flow method called DAG-NF to learn dependencies of input observation data. Inspired by Grad-CAM in computer vision, we use jacobian matrix of output on input as causal …