Dreaming is All You Need
In classification tasks, achieving a harmonious balance between exploration and precision is of paramount importance. To this end, this research introduces two novel deep learning models, SleepNet and DreamNet, to strike this balance. SleepNet seamlessly integrates supervised learning with unsupervised `sleep" stages using pre-trained encoder models. Dedicated neurons within SleepNet are embedded in these unsupervised features, forming intermittent `sleep" blocks that facilitate exploratory learning. Building upon the foundation of SleepNet, DreamNet employs full encoder-decoder frameworks to reconstruct the hidden states, mimicking the human "dreaming" process. This reconstruction process enables further exploration and refinement of the learned representations. Moreover, the principle ideas of our SleepNet and DreamNet are generic and can be applied to both computer vision and natural language processing downstream tasks. Through extensive empirical evaluations on diverse image and text datasets, SleepNet and DreanNet have demonstrated superior performance compared to state-of-the-art models, showcasing the strengths of unsupervised exploration and supervised precision afforded by our innovative approaches.
Code (1)
Tasks
AllDecoderSimilar Papers 제목 키워드 기반
DreamingV2: Reinforcement Learning with Discrete World Models without Reconstruction
The present paper proposes a novel reinforcement learning method with world models, DreamingV2, a collaborative extension of DreamerV2 and Dreaming. DreamerV2 is a cutting-edge model-based reinforcement learning from pix…
Contrastive LearningModel-based Reinforcement Learningreinforcement-learningReinforcement Learning+1Fluent dreaming for language models
Feature visualization, also known as "dreaming", offers insights into vision models by optimizing the inputs to maximize a neuron's activation or other internal component. However, dreaming has not been successfully appl…
Adversarial AttackLanguage ModelingLanguage ModellingMulti-View Dreaming: Multi-View World Model with Contrastive Learning
In this paper, we propose Multi-View Dreaming, a novel reinforcement learning agent for integrated recognition and control from multi-view observations by extending Dreaming. Most current reinforcement learning method as…
Contrastive Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)Learning Real-World Robot Policies by Dreaming
Learning to control robots directly based on images is a primary challenge in robotics. However, many existing reinforcement learning approaches require iteratively obtaining millions of robot samples to learn a policy, …
reinforcement-learningReinforcement LearningReinforcement Learning (RL)Functional neuroimaging of psychedelic experience: An overview of psychological and neural effects and their relevance to research on creativity, daydreaming, and dreaming
Humans have employed an incredible variety of plant-derived substances over the millennia in order to alter consciousness and perception. Among the innumerable narcotics, analgesics, 'ordeal' drugs, and other psychoactiv…