paper-with-me

홈 › Papers

Temporal Complexity of a Hopfield-Type Neural Model in Random and Scale-Free Graphs

2024-06-06 · Marco Cafiso, Paolo Paradisi

The Hopfield network model and its generalizations were introduced as a model of associative, or content-addressable, memory. They were widely investigated both as an unsupervised learning method in artificial intelligence and as a model of biological neural dynamics in computational neuroscience. The complexity features of biological neural networks have attracted the scientific community's interest for the last two decades. More recently, concepts and tools borrowed from complex network theory were applied to artificial neural networks and learning, thus focusing on the topological aspects. However, the temporal structure is also a crucial property displayed by biological neural networks and investigated in the framework of systems displaying complex intermittency. The Intermittency-Driven Complexity (IDC) approach indeed focuses on the metastability of self-organized states, whose signature is a power-decay in the inter-event time distribution or a scaling behaviour in the related event-driven diffusion processes. The investigation of IDC in neural dynamics and its relationship with network topology is still in its early stages. In this work, we present the preliminary results of an IDC analysis carried out on a bio-inspired Hopfield-type neural network comparing two different connectivities, i.e., scale-free vs. random network topology. We found that random networks can trigger complexity features similar to that of scale-free networks, even if with some differences and for different parameter values, in particular for different noise levels

📄 PDF Abstract BibTeX arXiv:2406.12895

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Complexity of Activity Patterns in a Bio-Inspired Hopfield-Type Network in Different Topologies

2025-09-23 · Marco Cafiso, Paolo Paradisi arxiv

Neural network models capable of storing memory have been extensively studied in computer science and computational neuroscience. The Hopfield network is a prototypical example of a model designed for associative, or con…

Nonparametric Modern Hopfield Models

2024-04-05 · Jerry Yao-Chieh Hu, Bo-Yu Chen, Dennis Wu, Feng Ruan 외

We present a nonparametric construction for deep learning compatible modern Hopfield models and utilize this framework to debut an efficient variant. Our key contribution stems from interpreting the memory storage and re…

Dense Hopfield Networks in the Teacher-Student Setting

2024-01-08 · Robin Thériault, Daniele Tantari

Dense Hopfield networks are known for their feature to prototype transition and adversarial robustness. However, previous theoretical studies have been mostly concerned with their storage capacity. We bridge this gap by …

Adversarial Robustness

Beyond Fixed Points: Superpolynomial Capacity of Asymmetric Hopfield Networks

2026-05-23 · Aakash Kumar, Anatoly Khina, Frederik Mallmann-Trenn, Emanuele Natale arxiv

Classical Hopfield networks are limited to static patterns due to symmetric weights, whereas asymmetric networks can encode temporal sequences via limit-cycle attractors. Achieving high-capacity storage of long sequences…

Temporal Sequences

Robust exponential binary pattern storage in Little-Hopfield networks

2015-04-29

The Little-Hopfield network is an auto-associative computational model of neural memory storage and retrieval. This model is known to robustly store collections of randomly generated binary patterns as stable-states of t…

DenoisingRetrieval