paper-with-me

홈 › Papers

Clustering of neural codewords revealed by a first-order phase transition

2016-02-22

A network of neurons in the central nervous system collectively represents information by its spiking activity states. Typically observed states, i.e., codewords, occupy only a limited portion of the state space due to constraints imposed by network interactions. Geometrical organization of codewords in the state space, critical for neural information processing, is poorly understood due to its high dimensionality. Here, we explore the organization of neural codewords using retinal data by computing the entropy of codewords as a function of Hamming distance from a particular reference codeword. Specifically, we report that the retinal codewords in the state space are divided into multiple distinct clusters separated by entropy-gaps, and that this structure is shared with well-known associative memory networks in a recallable phase. Our analysis also elucidates a special nature of the all-silent state. The all-silent state is surrounded by the densest cluster of codewords and located within a reachable distance from most codewords. This codeword-space structure quantitatively predicts typical deviation of a state-trajectory from its initial state. Altogether, our findings reveal a non-trivial heterogeneous structure of the codeword-space that shapes information representation in a biological network.

📄 PDF Abstract BibTeX arXiv:1602.06630

Code (0)

등록된 구현이 없습니다.

Tasks

Clustering

Similar Papers 제목 키워드 기반

Two-Step Codeword Design for Millimeter Wave Massive MIMO Systems with Quantized Phase Shifters

2020-02-15

In this paper, a two-step codeword design approach for millimeter wave (mmWave) massive MIMO systems is presented. Ideal codewords are first designed, which ignores the hardware constraints in terms of phase shifter reso…

Information Bottleneck-Inspired Type Based Multiple Access for Remote Estimation in IoT Systems

2022-12-19 · Meiyi Zhu, Chunyan Feng, Caili Guo, Nan Jiang 외

Type-based multiple access (TBMA) is a semantics-aware multiple access protocol for remote inference. In TBMA, codewords are reused across transmitting sensors, with each codeword being assigned to a different observatio…

Decoder

Compacting Binary Neural Networks by Sparse Kernel Selection

2023-03-25 · CVPR 2023 1 · Yikai Wang, Wenbing Huang, Yinpeng Dong, Fuchun Sun 외

Binary Neural Network (BNN) represents convolution weights with 1-bit values, which enhances the efficiency of storage and computation. This paper is motivated by a previously revealed phenomenon that the binary kernels …

Binarization

The Complete Anatomy of the Madden-Julian Oscillation Revealed by Artificial Intelligence

2025-12-14 · Xiao Zhou, Yuze Sun, Jie Wu, Xiaomeng Huang arxiv

Accurately defining the life cycle of the Madden-Julian Oscillation (MJO), the dominant mode of intraseasonal climate variability, remains a foundational challenge due to its propagating nature. The established linear-pr…

Encoding the Local Connectivity Patterns of fMRI for Cognitive State Classification

2016-10-17 · Itir Onal Ertugrul, Mete Ozay, Fatos T. Yarman Vural

In this work, we propose a novel framework to encode the local connectivity patterns of brain, using Fisher Vectors (FV), Vector of Locally Aggregated Descriptors (VLAD) and Bag-of-Words (BoW) methods. We first obtain lo…

ARCClusteringGeneral Classification