Predicting the future with a scale-invariant temporal memory for the past
In recent years it has become clear that the brain maintains a temporal memory of recent events stretching far into the past. This paper presents a neurally-inspired algorithm to use a scale-invariant temporal representation of the past to predict a scale-invariant future. The result is a scale-invariant estimate of future events as a function of the time at which they are expected to occur. The algorithm is time-local, with credit assigned to the present event by observing how it affects the prediction of the future. To illustrate the potential utility of this approach, we test the model on simultaneous renewal processes with different time scales. The algorithm scales well on these problems despite the fact that the number of states needed to describe them as a Markov process grows exponentially.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Generic construction of scale-invariantly coarse grained memory
Encoding temporal information from the recent past as spatially distributed activations is essential in order for the entire recent past to be simultaneously accessible. Any biological or synthetic agent that relies on t…
Future predictionNeural mechanism to simulate a scale-invariant future timeline
Predicting future events, and their order, is important for efficient planning. We propose a neural mechanism to non-destructively translate the current state of memory into the future, so as to construct an ordered set …
Future predictionHippocampusTranslationA time-causal and time-recursive scale-covariant scale-space representation of temporal signals and past time
This article presents an overview of a theory for performing temporal smoothing on temporal signals in such a way that: (i) temporally smoothed signals at coarser temporal scales are guaranteed to constitute simplificati…
Deep reinforcement learning with time-scale invariant memory
The ability to estimate temporal relationships is critical for both animals and artificial agents. Cognitive science and neuroscience provide remarkable insights into behavioral and neural aspects of temporal credit assi…
Deep Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)Memory-enhanced Invariant Prompt Learning for Urban Flow Prediction under Distribution Shifts
Urban flow prediction is a classic spatial-temporal forecasting task that estimates the amount of future traffic flow for a given location. Though models represented by Spatial-Temporal Graph Neural Networks (STGNNs) hav…
Prompt Learning