PerceptNet: A Human Visual System Inspired Neural Network for Estimating Perceptual Distance
Traditionally, the vision community has devised algorithms to estimate the distance between an original image and images that have been subject to perturbations. Inspiration was usually taken from the human visual perceptual system and how the system processes different perturbations in order to replicate to what extent it determines our ability to judge image quality. While recent works have presented deep neural networks trained to predict human perceptual quality, very few borrow any intuitions from the human visual system. To address this, we present PerceptNet, a convolutional neural network where the architecture has been chosen to reflect the structure and various stages in the human visual system. We evaluate PerceptNet on various traditional perception datasets and note strong performance on a number of them as compared with traditional image quality metrics. We also show that including a nonlinearity inspired by the human visual system in classical deep neural networks architectures can increase their ability to judge perceptual similarity. Compared to similar deep learning methods, the performance is similar, although our network has a number of parameters that is several orders of magnitude less.
Code (0)
등록된 구현이 없습니다.
Tasks
Perceptual DistanceSimilar Papers 제목 키워드 기반
From Images to Perception: Emergence of Perceptual Properties by Reconstructing Images
A number of scientists suggested that human visual perception may emerge from image statistics, shaping efficient neural representations in early vision. In this work, a bio-inspired architecture that can accommodate sev…
Image ReconstructionA Turing Test for Artificial Nets devoted to model Human Vision
In this 2022 work we argued that, despite claims about successful modeling of the visual brain using artificial nets, the problem is far from being solved (even for low-level vision). Examples of open issues include: whe…
Image SegmentationSemantic SegmentationParametric PerceptNet: A bio-inspired deep-net trained for Image Quality Assessment
Human vision models are at the core of image processing. For instance, classical approaches to the problem of image quality are based on models that include knowledge about human vision. However, nowadays, deep learning …
Image Quality AssessmentregressionHVS-Inspired Signal Degradation Network for Just Noticeable Difference Estimation
Significant improvement has been made on just noticeable difference (JND) modelling due to the development of deep neural networks, especially for the recently developed unsupervised-JND generation models. However, they …
Attentional Network for Visual Object Detection
We propose augmenting deep neural networks with an attention mechanism for the visual object detection task. As perceiving a scene, humans have the capability of multiple fixation points, each attended to scene content a…
Objectobject-detectionObject DetectionReinforcement Learning