paper-with-me

홈 › Papers

Predictive Learning in Energy-based Models with Attractor Structures

2025-01-23 · Xingsi Dong, Xiangyuan Peng, Si Wu

Predictive models are highly advanced in understanding the mechanisms of brain function. Recent advances in machine learning further underscore the power of prediction for optimal representation in learning. However, there remains a gap in creating a biologically plausible model that explains how the neural system achieves prediction. In this paper, we introduce a framework that employs an energy-based model (EBM) to capture the nuanced processes of predicting observation after action within the neural system, encompassing prediction, learning, and inference. We implement the EBM with a hierarchical structure and integrate a continuous attractor neural network for memory, constructing a biologically plausible model. In experimental evaluations, our model demonstrates efficacy across diverse scenarios. The range of actions includes eye movement, motion in environments, head turning, and static observation while the environment changes. Our model not only makes accurate predictions for environments it was trained on, but also provides reasonable predictions for unseen environments, matching the performances of machine learning methods in multiple tasks. We hope that this study contributes to a deep understanding of how the neural system performs prediction.

📄 PDF Abstract BibTeX arXiv:2501.13997

Code (0)

등록된 구현이 없습니다.

Tasks

Prediction

Methods 이 논문이 사용한 방법론

EBM 설명 없음

Similar Papers 제목 키워드 기반

Self-orthogonalizing attractor neural networks emerging from the free energy principle

2025-05-28 · Tamas Spisak, Karl Friston

Attractor dynamics are a hallmark of many complex systems, including the brain. Understanding how such self-organizing dynamics emerge from first principles is crucial for advancing our understanding of neuronal computat…

Spatial-aware decision-making with ring attractors in reinforcement learning systems

2024-10-04 · Marcos Negre Saura, Richard Allmendinger, Theodore Papamarkou, Wei Pan

This paper explores the integration of ring attractors, a mathematical model inspired by neural circuit dynamics, into the reinforcement learning (RL) action selection process. Ring attractors, as specialized brain-inspi…

Decision MakingReinforcement Learning (RL)

Attractor Selection in Nonlinear Energy Harvesting Using Deep Reinforcement Learning

2020-10-03 · Xue-She Wang, Brian P. Mann

Recent research efforts demonstrate that the intentional use of nonlinearity enhances the capabilities of energy harvesting systems. One of the primary challenges that arise in nonlinear harvesters is that nonlinearities…

Deep Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)+1

Controlled Dynamics Attractor Transformer

2026-06-13 · Cheng Zhang, Minnan Luo, Zesheng Yang, Ming Li 외 arxiv

Transformer architectures have dramatically advanced representation learning and inference in deep models through self-attention mechanisms. In parallel,associative memory (AM) frameworks map representations onto energy …

Representation LearningGraph Anomaly DetectionGraph Classification

Reasoning as Attractor Dynamics: Latent Memory Retrieval via Gibbs-Weighted Energy Minimization

2026-06-23 · Kanishk Awadhiya arxiv

Large Language Models (LLMs) are traditionally viewed as autoregressive generators. However, from the perspective of collective computation, they function as high-dimensional Dense Associative Memories that store complex…

Mathematical Reasoning