A Loss Function for Generative Neural Networks Based on Watson’s Perceptual Model
To train Variational Autoencoders (VAEs) to generate realistic imagery requires a loss function that reflects human perception of image similarity. We propose such a loss function based on Watson's perceptual model, which computes a weighted distance in frequency space and accounts for luminance and contrast masking. We extend the model to color images, increase its robustness to translation by using the Fourier Transform, remove artifacts due to splitting the image into blocks, and make it differentiable. In experiments, VAEs trained with the new loss function generated realistic, high-quality image samples. Compared to using the Euclidean distance and the Structural Similarity Index, the images were less blurry; compared to deep neural network based losses, the new approach required less computational resources and generated images with less artifacts.
Code (1)
Tasks
TranslationSimilar Papers 제목 키워드 기반
A Loss Function for Generative Neural Networks Based on Watson's Perceptual Model
To train Variational Autoencoders (VAEs) to generate realistic imagery requires a loss function that reflects human perception of image similarity. We propose such a loss function based on Watson's perceptual model, whic…
TranslationData is Overrated: Perceptual Metrics Can Lead Learning in the Absence of Training Data
Perceptual metrics are traditionally used to evaluate the quality of natural signals, such as images and audio. They are designed to mimic the perceptual behaviour of human observers and usually reflect structures found …
Pixel Co-Occurence Based Loss Metrics for Super Resolution Texture Recovery
Single Image Super Resolution (SISR) has significantly improved with Convolutional Neural Networks (CNNs) and Generative Adversarial Networks (GANs), often achieving order of magnitude better pixelwise accuracies (distor…
Image Super-ResolutionSuper-ResolutionChemical Property-Guided Neural Networks for Naphtha Composition Prediction
The naphtha cracking process heavily relies on the composition of naphtha, which is a complex blend of different hydrocarbons. Predicting the naphtha composition accurately is crucial for efficiently controlling the crac…
PredictionMatching Thermal to Visible Face Images Using a Semantic-Guided Generative Adversarial Network
Designing face recognition systems that are capable of matching face images obtained in the thermal spectrum with those obtained in the visible spectrum is a challenging problem. In this work, we propose the use of seman…
Face GenerationFace ParsingFace RecognitionGenerative Adversarial Network