Structured sparse coding via lateral inhibition
This work describes a conceptually simple method for structured sparse coding and dictionary design. Supposing a dictionary with K atoms, we introduce a structure as a set of penalties or interactions between every pair of atoms. We describe modifications of standard sparse coding algorithms for inference in this setting, and describe experiments showing that these algorithms are efficient. We show that interesting dictionaries can be learned for interactions that encode tree structures or locally connected structures. Finally, we show that our framework allows us to learn the values of the interactions from the data, rather than having them pre-specified.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Sparse Code Formation with Linear Inhibition
Sparse code formation in the primary visual cortex (V1) has been inspiration for many state-of-the-art visual recognition systems. To stimulate this behavior, networks are trained networks under mathematical constraint o…
Inhibition in Random Neuronal Networks Enhances Response Variability and Disrupts Stimulus Discrimination
Inhibition is considered to shape neural activity, and broaden its pattern repertoire. In the sensory organs, where the anatomy of neural circuits is highly structured, lateral inhibition sharpens contrast among stimulus…
AnatomyBlockingConvolutional Sparse Coding via the Locally Competitive Algorithm on Loihi 2
Sparse coding provides a principled framework for signal representation by expressing an input as a linear combination of only a small number of basis functions. The Locally Competitive Algorithm (LCA) is particularly at…
Emergence of robust looming selectivity via coordinated inhibitory neural computations
In the locust's lobula giant movement detector neural pathways, four categories of inhibition, i.e., global inhibition, self-inhibition, lateral inhibition, and feed-forward inhibition, have been functionally explored in…
Improved Training of Sparse Coding Variational Autoencoder via Weight Normalization
Learning a generative model of visual information with sparse and compositional features has been a challenge for both theoretical neuroscience and machine learning communities. Sparse coding models have achieved great s…
Decoder