paper-with-me

홈 › Papers

Neural Fields as World Models

2026-02-21 · Joshua Nunley arxiv

Humans rehearse possible futures offline, as in mental practice and perhaps dreaming, suggesting that world models may support task learning away from the environment. Standard machine learning world models compress visual input into latent vectors, discarding the spatial structure that characterizes sensory cortex. We propose isomorphic world models: architectures that preserve sensory topology, so physics prediction becomes geometric propagation rather than abstract state transition. We implement this idea with motor-gated neural fields, where activity evolves through local lateral connectivity and motor commands multiplicatively modulate specific channels. Across three experiments, the same architecture learns ballistic prediction without ``teleporting,'' improves a catching policy offline by propagating task error through a frozen learned world model, and develops body-selective motor channels without body labels. These results provide preliminary evidence that physical prediction, offline task learning, and body-linked representation share a common computational substrate: action-conditional prediction within a spatial map.

📄 PDF Abstract BibTeX arXiv:2602.18690

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

RefinedFields: Radiance Fields Refinement for Unconstrained Scenes

2023-12-01 · Karim Kassab, Antoine Schnepf, Jean-Yves Franceschi, Laurent Caraffa 외

Modeling large scenes from unconstrained images has proven to be a major challenge in computer vision. Existing methods tackling in-the-wild scene modeling operate in closed-world settings, where no conditioning on prior…

Neural RenderingNovel View Synthesis

FieldSeer I: Physics-Guided World Models for Long-Horizon Electromagnetic Dynamics under Partial Observability

2025-12-05 · Ziheng Guo, Fang Wu, Maoxiong Zhao, Chaoqun Fang 외 arxiv

We introduce FieldSeer I, a geometry-aware world model that forecasts electromagnetic field dynamics from partial observations in 2-D TE waveguides. The model assimilates a short prefix of observed fields, conditions on …

Colorizing Monochromatic Radiance Fields

2024-02-19 · Yean Cheng, Renjie Wan, Shuchen Weng, Chengxuan Zhu 외

Though Neural Radiance Fields (NeRF) can produce colorful 3D representations of the world by using a set of 2D images, such ability becomes non-existent when only monochromatic images are provided. Since color is necessa…

ColorizationImage ColorizationNeRF

Deformable Neural Radiance Fields using RGB and Event Cameras

2023-09-15 · ICCV 2023 1 · Qi Ma, Danda Pani Paudel, Ajad Chhatkuli, Luc van Gool

Modeling Neural Radiance Fields for fast-moving deformable objects from visual data alone is a challenging problem. A major issue arises due to the high deformation and low acquisition rates. To address this problem, we …

Slot-guided Volumetric Object Radiance Fields

2024-01-04 · NeurIPS 2023 11 · Di Qi, Tong Yang, Xiangyu Zhang

We present a novel framework for 3D object-centric representation learning. Our approach effectively decomposes complex scenes into individual objects from a single image in an unsupervised fashion. This method, called s…

ObjectRepresentation Learning