paper-with-me

홈 › Papers

In Praise of Artifice Reloaded: Caution with subjective image quality databases

2018-01-29

Subjective image quality databases are a major source of raw data on how the visual system works in naturalistic environments. These databases describe the sensitivity of many observers to a wide range of distortions (of different nature and with different suprathreshold intensities) seen on top of a variety of natural images. They seem like a dream for the vision scientist to check the models in realistic scenarios. However, while these natural databases are great benchmarks for models developed in some other way (e.g. by using the well-controlled artificial stimuli of traditional psychophysics), they should be carefully used when trying to fit vision models. Given the high dimensionality of the image space, it is very likely that some basic phenomenon (e.g. sensitivity to distortions in certain environments) are under-represented in the database. Therefore, a model fitted on these large-scale natural databases will not reproduce these under-represented basic phenomena that could otherwise be easily illustrated with well selected artificial stimuli. In this work we study a specific example of the above statement. A wavelet+divisive normalization layer of a sensible cascade of linear+nonlinear layers fitted to maximize the correlation with subjective opinion of observers on a large image quality database fails to reproduce basic crossmasking. Here we outline a solution for this problem using artificial stimuli. Then, we show that the resulting model is also a competitive solution for the large-scale database. In line with Rust and Movshon (2005), our report (misrepresentation of basic visual phenomena in subjectively-rated natural image databases) is an additional argument in praise of artifice.

📄 PDF Abstract BibTeX arXiv:1801.09632

Code (0)

등록된 구현이 없습니다.

Tasks

Sensitivity

Similar Papers 제목 키워드 기반

Visual Estimation of Building Condition with Patch-level ConvNets

2018-04-26 · David Koch, Miroslav Despotovic, Muntaha Sakeena, Mario Döller 외

The condition of a building is an important factor for real estate valuation. Currently, the estimation of condition is determined by real estate appraisers which makes it subjective to a certain degree. We propose a nov…

Metrics reloaded: Recommendations for image analysis validation

2022-06-03 · Lena Maier-Hein, Annika Reinke, Patrick Godau, Minu D. Tizabi 외

Increasing evidence shows that flaws in machine learning (ML) algorithm validation are an underestimated global problem. Particularly in automatic biomedical image analysis, chosen performance metrics often do not reflec…

Instance SegmentationMedical Image Analysisobject-detectionObject Detection+1

Seeking the Unfamiliar but Memorable: Conceptual Creativity as Meta-Learning

2026-05-15 · Mengye Ren arxiv

What does it mean to create a new concept, rather than retrieve a familiar one? Repeatedly sampling a generative model at the same prompt produces variations with similar styles and typical content. We propose that creat…

Sycophantic Praise: Evaluating Excessive Praise in Language Models

2026-06-05 · Daniel Vennemeyer, Phan Anh Duong, Meryl Ye, Ruihong Huang 외 arxiv

Sycophancy in language models is typically studied as excessive agreement or validation, while explicit praise and flattery have received comparatively little attention. We argue that sycophantic praise is a distinct ali…

Detecting Expressions of Blame or Praise in Text

2016-05-01 · LREC 2016 5 · Udochukwu Orizu, Yulan He

The growth of social networking platforms has drawn a lot of attentions to the need for social computing. Social computing utilises human insights for computational tasks as well as design of systems that support social …

Attribute