paper-with-me

홈 › Papers

NoiseNCA: Noisy Seed Improves Spatio-Temporal Continuity of Neural Cellular Automata

2024-04-09 · Ehsan Pajouheshgar, Yitao Xu, Sabine Süsstrunk

Neural Cellular Automata (NCA) is a class of Cellular Automata where the update rule is parameterized by a neural network that can be trained using gradient descent. In this paper, we focus on NCA models used for texture synthesis, where the update rule is inspired by partial differential equations (PDEs) describing reaction-diffusion systems. To train the NCA model, the spatio-temporal domain is discretized, and Euler integration is used to numerically simulate the PDE. However, whether a trained NCA truly learns the continuous dynamic described by the corresponding PDE or merely overfits the discretization used in training remains an open question. We study NCA models at the limit where space-time discretization approaches continuity. We find that existing NCA models tend to overfit the training discretization, especially in the proximity of the initial condition, also called "seed". To address this, we propose a solution that utilizes uniform noise as the initial condition. We demonstrate the effectiveness of our approach in preserving the consistency of NCA dynamics across a wide range of spatio-temporal granularities. Our improved NCA model enables two new test-time interactions by allowing continuous control over the speed of pattern formation and the scale of the synthesized patterns. We demonstrate this new NCA feature in our interactive online demo. Our work reveals that NCA models can learn continuous dynamics and opens new venues for NCA research from a dynamical system's perspective.

📄 PDF Abstract BibTeX arXiv:2404.06279

Code (0)

등록된 구현이 없습니다.

Tasks

continuous-controlContinuous ControlTexture Synthesis

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…
Focus 설명 없음

Similar Papers 제목 키워드 기반

G-SEED: A Spatio-temporal Encoding Framework for Forest and Grassland Data Based on GeoSOT

2025-06-22 · Xuan Ouyang, Xinwen Yu, Yan Chen, Guang Deng 외

In recent years, the rapid development of remote sensing, Unmanned Aerial Vehicles, and IoT technologies has led to an explosive growth in spatio-temporal forest and grassland data, which are increasingly multimodal, het…

Co-Fusion4D: Spatio-temporal Collaborative Fusion for Robust 3D Object Detection

2026-05-19 · Wenxuan Li, Qin Zou, Shoubing Chen, Chi Chen 외 arxiv

In autonomous driving, 3D object detection is essential for accurate perception and reliable decision-making. However, object motion and ego-motion often induce cross-frame spatiotemporal inconsistencies in BEV-based det…

Robust 3D Object DetectionAutonomous Driving

Adaptive Spatiotemporal Augmentation for Improving Dynamic Graph Learning

2025-01-17 · Xu Chu, Hanlin Xue, Bingce Wang, Xiaoyang Liu 외

Dynamic graph augmentation is used to improve the performance of dynamic GNNs. Most methods assume temporal locality, meaning that recent edges are more influential than earlier edges. However, for temporal changes in ed…

Graph LearningLink PredictionNode Classification

Leveraging Consistent Spatio-Temporal Correspondence for Robust Visual Odometry

2024-12-22 · Zhaoxing Zhang, Junda Cheng, Gangwei Xu, Xiaoxiang Wang 외

Recent approaches to VO have significantly improved performance by using deep networks to predict optical flow between video frames. However, existing methods still suffer from noisy and inconsistent flow matching, makin…

Optical Flow EstimationPose EstimationVisual Odometry

MSGM: A Multi-Scale Spatiotemporal Graph Mamba for EEG Emotion Recognition

2025-07-21 · Hanwen Liu, Yifeng Gong, Zuwei Yan, Zeheng Zhuang 외 arxiv

EEG-based emotion recognition struggles with capturing multi-scale spatiotemporal dynamics and ensuring computational efficiency for real-time applications. Existing methods often oversimplify temporal granularity and sp…

Computational EfficiencyEEG Emotion RecognitionEmotion Classification