paper-with-me

홈 › Papers

Synthesis and Perceptual Scaling of High Resolution Natural Images Using Stable Diffusion

2024-10-16 · Leonardo Pettini, Carsten Bogler, Christian Doeller, John-Dylan Haynes

Natural scenes are of key interest for visual perception. Previous work on natural scenes has frequently focused on collections of discrete images with considerable physical differences from stimulus to stimulus. For many purposes it would, however, be desirable to have sets of natural images that vary smoothly along a continuum (for example in order to measure quantitative properties such as thresholds or precisions). This problem has typically been addressed by morphing a source into a target image. However, this approach yields transitions between images that primarily follow their low-level physical features and that can be semantically unclear or ambiguous. Here, in contrast, we used a different approach (Stable Diffusion XL) to synthesise a custom stimulus set of photorealistic images that are characterized by gradual transitions where each image is a clearly interpretable but unique exemplar from the same category. We developed natural scene stimulus sets from six categories with 18 objects each. For each object we generated 10 graded variants that are ordered along a perceptual continuum. We validated the image set psychophysically in a large sample of participants, ensuring that stimuli for each exemplar have varying levels of perceptual confusability. This image set is of interest for studies on visual perception, attention and short- and long-term memory.

📄 PDF Abstract BibTeX arXiv:2410.13034

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…
SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Scaling Rectified Flow Transformers for High-Resolution Image Synthesis

2024-03-05 · Patrick Esser, Sumith Kulal, Andreas Blattmann, Rahim Entezari 외

Diffusion models create data from noise by inverting the forward paths of data towards noise and have emerged as a powerful generative modeling technique for high-dimensional, perceptual data such as images and videos. R…

Image GenerationReading ComprehensionText to Image Generation+1

Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network

2016-09-15 · CVPR 2017 7 · Christian Ledig, Lucas Theis, Ferenc Huszar, Jose Caballero 외

Despite the breakthroughs in accuracy and speed of single image super-resolution using faster and deeper convolutional neural networks, one central problem remains largely unsolved: how do we recover the finer texture de…

Generative Adversarial NetworkImage Super-ResolutionSuper-Resolution

Deep Learning-based Image Super-Resolution Considering Quantitative and Perceptual Quality

2018-09-13 · Jun-Ho Choi, Jun-Hyuk Kim, Manri Cheon, Jong-Seok Lee

Recently, it has been shown that in super-resolution, there exists a tradeoff relationship between the quantitative and perceptual quality of super-resolved images, which correspond to the similarity to the ground-truth …

Image Super-ResolutionSuper-Resolution

Perceptual Video Super Resolution with Enhanced Temporal Consistency

2018-07-20 · Eduardo Pérez-Pellitero, Mehdi S. M. Sajjadi, Michael Hirsch, Bernhard Schölkopf

With the advent of perceptual loss functions, new possibilities in super-resolution have emerged, and we currently have models that successfully generate near-photorealistic high-resolution images from their low-resoluti…

Image Super-ResolutionSuper-ResolutionVideo Super-Resolution

LEGAN: Disentangled Manipulation of Directional Lighting and Facial Expressions by Leveraging Human Perceptual Judgements

2020-10-04 · Sandipan Banerjee, Ajjen Joshi, Prashant Mahajan, Sneha Bhattacharya 외

Building facial analysis systems that generalize to extreme variations in lighting and facial expressions is a challenging problem that can potentially be alleviated using natural-looking synthetic data. Towards that, we…

Face Verification