Optimal Memory Encoding Through Fluctuation-Response Structure
Physical reservoir computing exploits the intrinsic dynamics of physical systems for information processing, while keeping the internal dynamics fixed and training only linear readouts; yet the role of input encoding remains poorly understood. We show that optimal input encoding is a geometric problem governed by the system's fluctuation-response structure. By measuring steady-state fluctuations and linear response, we derive an analytical criterion for the input direction that maximizes task-specific linear memory under a fixed power constraint, termed Response-based Optimal Memory Encoding (ROME). Backpropagation-based encoder optimization is shown to be equivalent to ROME, revealing a trade-off between task-dependent feature mixing and intrinsic noise. We apply ROME to various reservoir platforms, including spin-wave waveguides and spiking neural networks, demonstrating effective encoder design across physical and neuromorphic reservoirs, even in non-differentiable systems.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Preference-Aware Memory Update for Long-Term LLM Agents
One of the key factors influencing the reasoning capabilities of LLM-based agents is their ability to leverage long-term memory. Integrating long-term memory mechanisms allows agents to make informed decisions grounded i…
Knowledge GraphsInformation encoding and decoding in in-vitro neural networks on micro electrode arrays through stimulation timing
A primary challenge in utilizing in-vitro biological neural networks for computations is finding good encoding and decoding schemes for inputting and decoding data to and from the networks. Furthermore, identifying the o…
DecoderGeneric construction of scale-invariantly coarse grained memory
Encoding temporal information from the recent past as spatially distributed activations is essential in order for the entire recent past to be simultaneously accessible. Any biological or synthetic agent that relies on t…
Future predictionMemory Uncertainty Relation and Harmonic Memory in Random Recurrent Networks
We present an inequality that bounds the short-term memory capability of dynamical systems from below. It can be interpreted as an uncertainty relation between a measure of short-term memory and that of the size of state…
Cell information processing via frequency encoding and excitability
Cells continuously interact with their environment mediating their responses through signaling cascades. Very often, external stimuli induce pulsatile behaviors in intermediaries of the cascade of increasing frequency wi…