paper-with-me

홈 › Papers

Learning to Observe: Approximating Human Perceptual Thresholds for Detection of Suprathreshold Image Transformations

2019-12-13 · CVPR 2020 6 · Alan Dolhasz, Carlo Harvey, Ian Williams

Many tasks in computer vision are often calibrated and evaluated relative to human perception. In this paper, we propose to directly approximate the perceptual function performed by human observers completing a visual detection task. Specifically, we present a novel methodology for learning to detect image transformations visible to human observers through approximating perceptual thresholds. To do this, we carry out a subjective two-alternative forced-choice study to estimate perceptual thresholds of human observers detecting local exposure shifts in images. We then leverage transformation equivariant representation learning to overcome issues of limited perceptual data. This representation is then used to train a dense convolutional classifier capable of detecting local suprathreshold exposure shifts - a distortion common to image composites. In this context, our model can approximate perceptual thresholds with an average error of 0.1148 exposure stops between empirical and predicted thresholds. It can also be trained to detect a range of different local transformations.

📄 PDF Abstract BibTeX arXiv:1912.06433

Code (1)

dmt-lab/learning-to-observe 공식 구현

Tasks

Representation Learning

Similar Papers 제목 키워드 기반

Analysis and Interpretation of Deep CNN Representations as Perceptual Quality Features

2019-09-25 · Taimoor Tariq, Munchurl Kim

Pre-trained Deep Convolutional Neural Network (CNN) features have popularly been used as full-reference perceptual quality features for CNN based image quality assessment, super-resolution, image restoration and a variet…

Image Quality AssessmentImage RestorationImage-to-Image Translationobject-detection+2

Artificial Rigidities vs. Biological Noise: A Comparative Analysis of Multisensory Integration in AV-HuBERT and Human Observers

2026-01-22 · Francisco Portillo López arxiv

This study evaluates AV-HuBERT's perceptual bio-fidelity by benchmarking its response to incongruent audiovisual stimuli (McGurk effect) against human observers (N=44). Results reveal a striking quantitative isomorphism:…

Human Echolocation in Static Situations: Auditory Models of Detection Thresholds for Distance, Pitch, Loudness and Timbre

2018-01-30

We investigated, by using auditory models, how three perceptual parameters, loudness, pitch and sharpness, determine human echolocation. We used acoustic recordings from two previous studies, both from stationary situati…

Galvanic vestibular stimulation produces cross-modal improvements in visual thresholds

2021-01-26 · Jamie L. Voros, Sage O. Sherman, Rachel Rise, Alexander Kryuchkov 외

Background: Stochastic resonance (SR) refers to a faint signal being enhanced with the addition of white noise. Previous studies have found that vestibular perceptual thresholds are lowered with noisy galvanic vestibular…

Tracking momentary attention fluctuations with an EEG-based cognitive brain-machine interface

2019-09-11 · Anonymous

Momentary fluctuations in attention (perceptual accuracy) correlate with neural activity fluctuations in primate visual areas. Yet, the link between such momentary neural fluctuations and attention state remains to be sh…

EEGElectroencephalogram (EEG)SSVEP