A Turing Test for Artificial Nets devoted to model Human Vision
In this 2022 work we argued that, despite claims about successful modeling of the visual brain using artificial nets, the problem is far from being solved (even for low-level vision). Examples of open issues include: where should we read from ANNs in order to reproduce human behavior?, this ad-hoc read-out is considered part of the brain model or not?, should we use artificial psychophysics or artificial physiology?, in the case of ANNs, artificial experiments should literally match the experiments done with humans?. There is a clear need of rigorous procedures for experimental tests for ANNs devoted to model the visual brain, and more generally, to understand ANNs devoted to generic vision tasks. Following our experience in using low-level facts from Quantitative Visual Neuroscience in computer vision, in this work we presented the idea of developing a low-level dataset compiling the basic spatio-temporal and chromatic facts that are known to happen in the retina-V1 pathway, and they are not currently available in existing databases such as BrainScore. In our results we checked the behavior of three recently proposed models with similar architecture: (1) A parametric model tuned via Maximum Differentiation [Malo & Simoncelli SPIE 15, Martinez et al. PLOS 18, Martinez et al. Front. Neurosci. 19], (2) A non-parametric model called PerceptNet tuned to maximize the correlation with human opinion on subjective distortions [Hepburn et al. IEEE ICIP 19], and (3) A model with the same encoder as PerceptNet, but tuned for image segmentation (published as Hernandez-Camara et al. Patt.Recogn.Lett. 23). Results on 10 compelling psycho/physio visual facts show that the first model is the one with closer behavior to the humans in terms of receptive fields, but more interestingly, on the nonlinear behavior when facing complex spatio-chromatic patterns of a range of luminances and contrasts.
Code (0)
등록된 구현이 없습니다.
Tasks
Image SegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
Normality and the Turing Test
This paper proposes to revisit the Turing test through the concept of normality. Its core argument is that the Turing test is a test of normal intelligence as assessed by a normal judge. First, in the sense that the Turi…
The Information-theoretic and Algorithmic Approach to Human, Animal and Artificial Cognition
We survey concepts at the frontier of research connecting artificial, animal and human cognition to computation and information processing---from the Turing test to Searle's Chinese Room argument, from Integrated Informa…
People cannot distinguish GPT-4 from a human in a Turing test
We evaluated 3 systems (ELIZA, GPT-3.5 and GPT-4) in a randomized, controlled, and preregistered Turing test. Human participants had a 5 minute conversation with either a human or an AI, and judged whether or not they th…
AI-Driven Agents with Prompts Designed for High Agreeableness Increase the Likelihood of Being Mistaken for a Human in the Turing Test
Large Language Models based on transformer algorithms have revolutionized Artificial Intelligence by enabling verbal interaction with machines akin to human conversation. These AI agents have surpassed the Turing Test, a…
AI AgentPassed the Turing Test: Living in Turing Futures
The world has seen the emergence of machines based on pretrained models, transformers, also known as generative artificial intelligences for their ability to produce various types of content, including text, images, audi…