paper-with-me

홈 › Papers

Visual Search Asymmetry: Deep Nets and Humans Share Similar Inherent Biases

2021-06-05 · NeurIPS 2021 12 · Shashi Kant Gupta, Mengmi Zhang, Chia-Chien Wu, Jeremy M. Wolfe, Gabriel Kreiman

Visual search is a ubiquitous and often challenging daily task, exemplified by looking for the car keys at home or a friend in a crowd. An intriguing property of some classical search tasks is an asymmetry such that finding a target A among distractors B can be easier than finding B among A. To elucidate the mechanisms responsible for asymmetry in visual search, we propose a computational model that takes a target and a search image as inputs and produces a sequence of eye movements until the target is found. The model integrates eccentricity-dependent visual recognition with target-dependent top-down cues. We compared the model against human behavior in six paradigmatic search tasks that show asymmetry in humans. Without prior exposure to the stimuli or task-specific training, the model provides a plausible mechanism for search asymmetry. We hypothesized that the polarity of search asymmetry arises from experience with the natural environment. We tested this hypothesis by training the model on augmented versions of ImageNet where the biases of natural images were either removed or reversed. The polarity of search asymmetry disappeared or was altered depending on the training protocol. This study highlights how classical perceptual properties can emerge in neural network models, without the need for task-specific training, but rather as a consequence of the statistical properties of the developmental diet fed to the model. All source code and data are publicly available at https://github.com/kreimanlab/VisualSearchAsymmetry.

📄 PDF Abstract BibTeX arXiv:2106.02953

Code (1)

kreimanlab/VisualSearchAsymmetry 공식 구현 tf

Similar Papers 제목 키워드 기반

On the Effect of Information Asymmetry in Human-AI Teams

2022-05-03 · Patrick Hemmer, Max Schemmer, Niklas Kühl, Michael Vössing 외

Over the last years, the rising capabilities of artificial intelligence (AI) have improved human decision-making in many application areas. Teaming between AI and humans may even lead to complementary team performance (C…

Decision MakingExplainable Artificial Intelligence (XAI)

Do vision-language models search like humans? Reasoning tokens as a reaction-time analog in classic visual-search paradigms

2026-06-23 · Farahnaz Wick arxiv

Visual search has been one of the most productive paradigms in the study of visual attention: the way reaction time scales with the number of items distinguishes parallel, "pop-out" search from serial, attention-demandin…

Analysis of Deep Image Quality Models

2023-02-26 · Pablo Hernández-Cámara, Jorge Vila-Tomás, Valero Laparra, Jesús Malo

Subjective image quality measures based on deep neural networks are very related to models of visual neuroscience. This connection benefits engineering but, more interestingly, the freedom to optimize deep networks in di…

SSIM

Directional Confusions Reveal Divergent Inductive Biases Through Rate-Distortion Geometry in Human and Machine Vision

2026-04-23 · Leyla Roksan Caglar, Pedro A. M. Mediano, Baihan Lin arxiv

To humans, a robin seems more like a bird than a bird seems like a robin, but does this asymmetry also hold for machine vision? Humans and modern vision models can match each other in accuracy while making systematically…

Salient Facial Features from Humans and Deep Neural Networks

2020-03-08 · Shanmeng Sun, Wei Zhen Teoh, Michael Guerzhoy

In this work, we explore the features that are used by humans and by convolutional neural networks (ConvNets) to classify faces. We use Guided Backpropagation (GB) to visualize the facial features that influence the outp…