paper-with-me

Papers

Inference via Sparse Coding in a Hierarchical Vision Model

2021-08-03 · Joshua Bowren, Luis Sanchez-Giraldo, Odelia Schwartz

Sparse coding has been incorporated in models of the visual cortex for its computational advantages and connection to biology. But how the level of sparsity contributes to performance on visual tasks is not well understood. In this work, sparse coding has been integrated into an existing hierarchical V2 model (Hosoya and Hyv\"arinen, 2015), but replacing its independent component analysis (ICA) with an explicit sparse coding in which the degree of sparsity can be controlled. After training, the sparse coding basis functions with a higher degree of sparsity resembled qualitatively different structures, such as curves and corners. The contributions of the models were assessed with image classification tasks, specifically tasks associated with mid-level vision including figure-ground classification, texture classification, and angle prediction between two line stimuli. In addition, the models were assessed in comparison to a texture sensitivity measure that has been reported in V2 (Freeman et al., 2013), and a deleted-region inference task. The results from the experiments show that while sparse coding performed worse than ICA at classifying images, only sparse coding was able to better match the texture sensitivity level of V2 and infer deleted image regions, both by increasing the degree of sparsity in sparse coding. Higher degrees of sparsity allowed for inference over larger deleted image regions. The mechanism that allows for this inference capability in sparse coding is described here.

📄 PDF Abstract BibTeX arXiv:2108.01548

Code (1)

https://notabug.org/jbowren/hv2model 공식 구현

Tasks

image-classificationImage ClassificationSensitivityTexture Classification

Methods 이 논문이 사용한 방법론

ICA _Independent component analysis (ICA) is a statistical and computational technique for revealing hidden factors that underlie sets of random variables, measurements, or…

Similar Papers 제목 키워드 기반

Accelerating Hierarchical Sparse Predictive Coding with Hybrid Amortized Inference

2026-06-26 · Kazuhisa Fujita arxiv

Hierarchical predictive coding provides an interpretable framework for perception as error-driven inference in multi-layer generative models, while sparse coding imposes parsimonious latent representations through explic…

Exploitation of Image Statistics with Sparse Coding in the Case of Stereo Vision

2021-01-24 · Gerrit A. Ecke, Harald M. Papp, Hanspeter A. Mallot

The sparse coding algorithm has served as a model for early processing in mammalian vision. It has been assumed that the brain uses sparse coding to exploit statistical properties of the sensory stream. We hypothesize th…

A Sparse Coding Interpretation of Neural Networks and Theoretical Implications

2021-08-14 · Joshua Bowren

Neural networks, specifically deep convolutional neural networks, have achieved unprecedented performance in various computer vision tasks, but the rationale for the computations and structures of successful neural netwo…

image-classificationImage Classification

Hierarchical Concept Embedding & Pursuit for Interpretable Image Classification

2026-02-11 · Nghia Nguyen, Tianjiao Ding, René Vidal arxiv

Interpretable-by-design models are gaining traction in computer vision because they provide faithful explanations for their predictions. In image classification, these models typically recover human-interpretable concept…

Image Classification

Double-P: Hierarchical Top-P Sparse Attention for Long-Context LLMs

2026-02-05 · Wentao Ni, Kangqi Zhang, Zhongming Yu, Oren Nelson 외 arxiv

As long-context inference becomes central to large language models (LLMs), attention over growing key-value caches emerges as a dominant decoding bottleneck, motivating sparse attention for scalable inference. Fixed-budg…