Modulation of early visual processing alleviates capacity limits in solving multiple tasks
In daily life situations, we have to perform multiple tasks given a visual stimulus, which requires task-relevant information to be transmitted through our visual system. When it is not possible to transmit all the possibly relevant information to higher layers, due to a bottleneck, task-based modulation of early visual processing might be necessary. In this work, we report how the effectiveness of modulating the early processing stage of an artificial neural network depends on the information bottleneck faced by the network. The bottleneck is quantified by the number of tasks the network has to perform and the neural capacity of the later stage of the network. The effectiveness is gauged by the performance on multiple object detection tasks, where the network is trained with a recent multi-task optimization scheme. By associating neural modulations with task-based switching of the state of the network and characterizing when such switching is helpful in early processing, our results provide a functional perspective towards understanding why task-based modulation of early neural processes might be observed in the primate visual cortex
Code (1)
Tasks
object-detectionObject DetectionSimilar Papers 제목 키워드 기반
A Novel Modulation Scheme Based on the Kramers--Kronig Relations for Optical IM/DD Systems
The ever-growing demand for higher data rates in optical communication systems necessitates the development of advanced modulation formats capable of significantly enhancing system performance. In this work, we propose a…
SensitivityState-dependent regulation of cortical processing speed via gain modulation
To thrive in dynamic environments, animals must be capable of rapidly and flexibly adapting behavioral responses to a changing context and internal state. Examples of behavioral flexibility include faster stimulus respon…
Task-dependent modulation of the visual sensory thalamus assists visual-speech recognition
The cerebral cortex modulates early sensory processing via feed-back connections to sensory pathway nuclei. The functions of this top-down modulation for human behavior are poorly understood. Here, we show that top-down …
Face Identificationspeech-recognitionSpeech RecognitionVisual Speech RecognitionMultiplicative modulations in hue-selective cells enhance unique hue representation
There is still much to understand about the color processing mechanisms in the brain and the transformation from cone-opponent representations to perceptual hues. Moreover, it is unclear which areas(s) in the brain repre…
Statistical Models of Linear and Nonlinear Contextual Interactions in Early Visual Processing
A central hypothesis about early visual processing is that it represents inputs in a coordinate system matched to the statistics of natural scenes. Simple versions of this lead to Gabor-like receptive fields and divisive…