Eigenvector Dreaming
Among the performance-enhancing procedures for Hopfield-type networks that implement associative memory, Hebbian Unlearning (or dreaming) strikes for its simplicity and its clear biological interpretation. Yet, it does not easily lend itself to a clear analytical understanding. Here we show how Hebbian Unlearning can be effectively described in terms of a simple evolution of the spectrum and the eigenvectors of the coupling matrix. We use these ideas to design new dreaming algorithms that are effective from a computational point of view, and are analytically far more transparent than the original scheme.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
DreamingV2: Reinforcement Learning with Discrete World Models without Reconstruction
The present paper proposes a novel reinforcement learning method with world models, DreamingV2, a collaborative extension of DreamerV2 and Dreaming. DreamerV2 is a cutting-edge model-based reinforcement learning from pix…
Contrastive LearningModel-based Reinforcement Learningreinforcement-learningReinforcement Learning+1Fluent dreaming for language models
Feature visualization, also known as "dreaming", offers insights into vision models by optimizing the inputs to maximize a neuron's activation or other internal component. However, dreaming has not been successfully appl…
Adversarial AttackLanguage ModelingLanguage ModellingMulti-View Dreaming: Multi-View World Model with Contrastive Learning
In this paper, we propose Multi-View Dreaming, a novel reinforcement learning agent for integrated recognition and control from multi-view observations by extending Dreaming. Most current reinforcement learning method as…
Contrastive Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)Learning Real-World Robot Policies by Dreaming
Learning to control robots directly based on images is a primary challenge in robotics. However, many existing reinforcement learning approaches require iteratively obtaining millions of robot samples to learn a policy, …
reinforcement-learningReinforcement LearningReinforcement Learning (RL)Functional neuroimaging of psychedelic experience: An overview of psychological and neural effects and their relevance to research on creativity, daydreaming, and dreaming
Humans have employed an incredible variety of plant-derived substances over the millennia in order to alter consciousness and perception. Among the innumerable narcotics, analgesics, 'ordeal' drugs, and other psychoactiv…