paper-with-me

홈 › Papers

Improving Image Autoencoder Embeddings with Perceptual Loss

2020-01-10 · Gustav Grund Pihlgren, Fredrik Sandin, Marcus Liwicki

Autoencoders are commonly trained using element-wise loss. However, element-wise loss disregards high-level structures in the image which can lead to embeddings that disregard them as well. A recent improvement to autoencoders that helps alleviate this problem is the use of perceptual loss. This work investigates perceptual loss from the perspective of encoder embeddings themselves. Autoencoders are trained to embed images from three different computer vision datasets using perceptual loss based on a pretrained model as well as pixel-wise loss. A host of different predictors are trained to perform object positioning and classification on the datasets given the embedded images as input. The two kinds of losses are evaluated by comparing how the predictors performed with embeddings from the differently trained autoencoders. The results show that, in the image domain, the embeddings generated by autoencoders trained with perceptual loss enable more accurate predictions than those trained with element-wise loss. Furthermore, the results show that, on the task of object positioning of a small-scale feature, perceptual loss can improve the results by a factor 10. The experimental setup is available online: https://github.com/guspih/Perceptual-Autoencoders

📄 PDF Abstract BibTeX arXiv:2001.03444

Code (1)

guspih/Perceptual-Autoencoders 공식 구현 pytorch

Similar Papers 제목 키워드 기반

Pretraining Image Encoders without Reconstruction via Feature Prediction Loss

2020-03-16 · Gustav Grund Pihlgren, Fredrik Sandin, Marcus Liwicki

This work investigates three methods for calculating loss for autoencoder-based pretraining of image encoders: The commonly used reconstruction loss, the more recently introduced deep perceptual similarity loss, and a fe…

Prediction

Generating Images with Perceptual Similarity Metrics based on Deep Networks

2016-02-08 · NeurIPS 2016 12 · Alexey Dosovitskiy, Thomas Brox

Image-generating machine learning models are typically trained with loss functions based on distance in the image space. This often leads to over-smoothed results. We propose a class of loss functions, which we call deep…

Image Generation

Boosting Latent Diffusion with Perceptual Objectives

2024-11-06 · Tariq Berrada, Pietro Astolfi, Melissa Hall, Marton Havasi 외

Latent diffusion models (LDMs) power state-of-the-art high-resolution generative image models. LDMs learn the data distribution in the latent space of an autoencoder (AE) and produce images by mapping the generated laten…

Decoder

A Compression Objective and a Cycle Loss for Neural Image Compression

2019-05-24 · Caglar Aytekin, Francesco Cricri, Antti Hallapuro, Jani Lainema 외

In this manuscript we propose two objective terms for neural image compression: a compression objective and a cycle loss. These terms are applied on the encoder output of an autoencoder and are used in combination with r…

Image CompressionMS-SSIMSSIM

Data is Overrated: Perceptual Metrics Can Lead Learning in the Absence of Training Data

2023-12-06 · Tashi Namgyal, Alexander Hepburn, Raul Santos-Rodriguez, Valero Laparra 외

Perceptual metrics are traditionally used to evaluate the quality of natural signals, such as images and audio. They are designed to mimic the perceptual behaviour of human observers and usually reflect structures found …