Coherent noise enables probabilistic sequence replay in spiking neuronal networks

2022-06-21 · Younes Bouhadjar, Dirk J. Wouters, Markus Diesmann, Tom Tetzlaff

Animals rely on different decision strategies when faced with ambiguous or uncertain cues. Depending on the context, decisions may be biased towards events that were most frequently experienced in the past, or be more explorative. A particular type of decision making central to cognition is sequential memory recall in response to ambiguous cues. A previously developed spiking neuronal network implementation of sequence prediction and recall learns complex, high-order sequences in an unsupervised manner by local, biologically inspired plasticity rules. In response to an ambiguous cue, the model deterministically recalls the sequence shown most frequently during training. Here, we present an extension of the model enabling a range of different decision strategies. In this model, explorative behavior is generated by supplying neurons with noise. As the model relies on population encoding, uncorrelated noise averages out, and the recall dynamics remain effectively deterministic. In the presence of locally correlated noise, the averaging effect is avoided without impairing the model performance, and without the need for large noise amplitudes. We investigate two forms of correlated noise occurring in nature: shared synaptic background inputs, and random locking of the stimulus to spatiotemporal oscillations in the network activity. Depending on the noise characteristics, the network adopts various replay strategies. This study thereby provides potential mechanisms explaining how the statistics of learned sequences affect decision making, and how decision strategies can be adjusted after learning.

📄 PDF Abstract BibTeX arXiv:2206.10538

Code (0)

등록된 구현이 없습니다.

Tasks

Decision Making

Neural Probabilistic Amplitude Shaping for Nonlinear Fiber Channels

2026-02-02 · Mohammad Taha Askari, Lutz Lampe, Amirhossein Ghazisaeidi arxiv

We introduce neural probabilistic amplitude shaping, a joint-distribution learning framework for coherent fiber systems. The proposed scheme provides a 0.5 dB signal-to-noise ratio gain over sequence selection for dual-p…

Experience Replay Using Transition Sequences

2017-05-30 · Thommen George Karimpanal, Roland Bouffanais

Experience replay is one of the most commonly used approaches to improve the sample efficiency of reinforcement learning algorithms. In this work, we propose an approach to select and replay sequences of transitions in o…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Detachedly Learn a Classifier for Class-Incremental Learning

2023-02-23 · Ziheng Li, Shibo Jie, Zhi-Hong Deng

In continual learning, model needs to continually learn a feature extractor and classifier on a sequence of tasks. This paper focuses on how to learn a classifier based on a pretrained feature extractor under continual l…

class-incremental learning Class Incremental Learning Continual Learning Incremental Learning

Clustering sequence sets for motif discovery

2009-12-01 · NeurIPS 2009 12 · Jong K. Kim, Seungjin Choi

Most of existing methods for DNA motif discovery consider only a single set of sequences to find an over-represented motif. In contrast, we consider multiple sets of sequences where we group sets associated with the same…

Clustering

Posterior Meta-Replay for Continual Learning

2021-03-01 · NeurIPS 2021 12 · Christian Henning, Maria R. Cervera, Francesco D'Angelo, Johannes von Oswald 외

Learning a sequence of tasks without access to i.i.d. observations is a widely studied form of continual learning (CL) that remains challenging. In principle, Bayesian learning directly applies to this setting, since rec…

Continual Learning