paper-with-me

홈 › Papers

Alternating Shrinking Higher-order Interactions for Sparse Neural Population Activity

2023-08-25 · Ulises Rodríguez-Domínguez, Hideaki Shimazaki

Neurons in living things work cooperatively and efficiently to process incoming sensory information, often exhibiting sparse and widespread population activity involving structured higher-order interactions. While there are statistical models based on continuous probability distributions for neurons' sparse firing rates, how the spiking activities of a large number of interacting neurons result in the sparse and widespread population activity remains unknown. Here, for homogeneous (0,1) binary neurons, we provide sufficient conditions under which their spike-count population distribution converges to a sparse widespread distribution of the population spike rate in an infinitely large population of neurons. Following the conditions, we propose new models belonging to an exponential family distribution in which the sign and magnitude of neurons' higher-order interactions alternate and shrink as the order increases. The distributions exhibit parameter-dependent sparsity on a bounded support for the population firing rate. The theory serves as a building block for developing prior distributions and neurons' non-linearity for spike-based sparse coding.

📄 PDF Abstract BibTeX arXiv:2308.13257

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Inflate and Shrink:Enriching and Reducing Interactions for Fast Text-Image Retrieval

2021-11-01 · EMNLP 2021 11 · Haoliang Liu, Tan Yu, Ping Li

By exploiting the cross-modal attention, cross-BERT methods have achieved state-of-the-art accuracy in cross-modal retrieval. Nevertheless, the heavy text-image interactions in the cross-BERT model are prohibitively slow…

Cross-Modal RetrievalImage RetrievalRetrieval

Nonconvex Nonsmooth Low-Rank Minimization for Generalized Image Compressed Sensing via Group Sparse Representation

2019-11-18 · Yunyi Li, Li Liu, Yu Zhao, Xiefeng Cheng 외

Group sparse representation (GSR) based method has led to great successes in various image recovery tasks, which can be converted into a low-rank matrix minimization problem. As a widely used surrogate function of low-ra…

compressed sensingCompressive SensingImage Compressed Sensing

Higher-Order Token Interactions via Quantum Attention

2026-06-10 · Jian Xu, Chao Li, Delu Zeng, John Paisley 외 arxiv

Standard dot-product self-attention computes, in a single layer, only pairwise (order-2) interactions between tokens; representing a generic order-$k$ interaction is known to require either super-quadratic resources in o…

On associative neural networks for sparse patterns with huge capacities

2026-03-27 · Matthias Löwe, Franck Vermet arxiv

Generalized Hopfield models with higher-order or exponential interaction terms are known to have substantially larger storage capacities than the classical quadratic model. On the other hand, associative memories for spa…

A Data-Driven Framework for Discovering Fractional Differential Equations in Complex Systems

2024-12-05 · Xiangnan Yu, Hao Xu, Zhiping Mao, Hongguang Sun 외

In complex physical systems, conventional differential equations often fall short in capturing non-local and memory effects, as they are limited to local dynamics and integer-order interactions. This study introduces a s…

Denoisingglobal-optimization