Learning to Observe: Approximating Human Perceptual Thresholds for Detection of Suprathreshold Image Transformations
Many tasks in computer vision are often calibrated and evaluated relative to human perception. In this paper, we propose to directly approximate the perceptual function performed by human observers completing a visual detection task. Specifically, we present a novel methodology for learning to detect image transformations visible to human observers through approximating perceptual thresholds. To do this, we carry out a subjective two-alternative forced-choice study to estimate perceptual thresholds of human observers detecting local exposure shifts in images. We then leverage transformation equivariant representation learning to overcome issues of limited perceptual data. This representation is then used to train a dense convolutional classifier capable of detecting local suprathreshold exposure shifts - a distortion common to image composites. In this context, our model can approximate perceptual thresholds with an average error of 0.1148 exposure stops between empirical and predicted thresholds. It can also be trained to detect a range of different local transformations.
Code (1)
Tasks
Representation LearningSimilar Papers 제목 키워드 기반
Analysis and Interpretation of Deep CNN Representations as Perceptual Quality Features
Pre-trained Deep Convolutional Neural Network (CNN) features have popularly been used as full-reference perceptual quality features for CNN based image quality assessment, super-resolution, image restoration and a variet…
Image Quality AssessmentImage RestorationImage-to-Image Translationobject-detection+2Artificial Rigidities vs. Biological Noise: A Comparative Analysis of Multisensory Integration in AV-HuBERT and Human Observers
This study evaluates AV-HuBERT's perceptual bio-fidelity by benchmarking its response to incongruent audiovisual stimuli (McGurk effect) against human observers (N=44). Results reveal a striking quantitative isomorphism:…
Human Echolocation in Static Situations: Auditory Models of Detection Thresholds for Distance, Pitch, Loudness and Timbre
We investigated, by using auditory models, how three perceptual parameters, loudness, pitch and sharpness, determine human echolocation. We used acoustic recordings from two previous studies, both from stationary situati…
Galvanic vestibular stimulation produces cross-modal improvements in visual thresholds
Background: Stochastic resonance (SR) refers to a faint signal being enhanced with the addition of white noise. Previous studies have found that vestibular perceptual thresholds are lowered with noisy galvanic vestibular…
Tracking momentary attention fluctuations with an EEG-based cognitive brain-machine interface
Momentary fluctuations in attention (perceptual accuracy) correlate with neural activity fluctuations in primate visual areas. Yet, the link between such momentary neural fluctuations and attention state remains to be sh…
EEGElectroencephalogram (EEG)SSVEP