paper-with-me

홈 › Papers

Learning a Virtual Codec Based on Deep Convolutional Neural Network to Compress Image

2017-12-16 · Lijun Zhao, Huihui Bai, Anhong Wang, Yao Zhao

Although deep convolutional neural network has been proved to efficiently eliminate coding artifacts caused by the coarse quantization of traditional codec, it's difficult to train any neural network in front of the encoder for gradient's back-propagation. In this paper, we propose an end-to-end image compression framework based on convolutional neural network to resolve the problem of non-differentiability of the quantization function in the standard codec. First, the feature description neural network is used to get a valid description in the low-dimension space with respect to the ground-truth image so that the amount of image data is greatly reduced for storage or transmission. After image's valid description, standard image codec such as JPEG is leveraged to further compress image, which leads to image's great distortion and compression artifacts, especially blocking artifacts, detail missing, blurring, and ringing artifacts. Then, we use a post-processing neural network to remove these artifacts. Due to the challenge of directly learning a non-linear function for a standard codec based on convolutional neural network, we propose to learn a virtual codec neural network to approximate the projection from the valid description image to the post-processed compressed image, so that the gradient could be efficiently back-propagated from the post-processing neural network to the feature description neural network during training. Meanwhile, an advanced learning algorithm is proposed to train our deep neural networks for compression. Obviously, the priority of the proposed method is compatible with standard existing codecs and our learning strategy can be easily extended into these codecs based on convolutional neural network. Experimental results have demonstrated the advances of the proposed method as compared to several state-of-the-art approaches, especially at very low bit-rate.

📄 PDF Abstract BibTeX arXiv:1712.05969

Code (1)

mdcnn/mdcnn.github.io

Tasks

BlockingImage CompressionQuantizationvalid

Similar Papers 제목 키워드 기반

Mixed-Resolution Image Representation and Compression with Convolutional Neural Networks

2018-02-02 · Lijun Zhao, Huihui Bai, Feng Li, Anhong Wang 외

In this paper, we propose an end-to-end mixed-resolution image compression framework with convolutional neural networks. Firstly, given one input image, feature description neural network (FDNN) is used to generate a new…

Image CompressionQuantization

Implicit-explicit Integrated Representations for Multi-view Video Compression

2023-11-29 · Chen Zhu, Guo Lu, Bing He, Rong Xie 외

With the increasing consumption of 3D displays and virtual reality, multi-view video has become a promising format. However, its high resolution and multi-camera shooting result in a substantial increase in data volume, …

Video Compression

Improved Hybrid Layered Image Compression using Deep Learning and Traditional Codecs

2019-07-15 · Haisheng Fu, Feng Liang, Bo Lei, Nai Bian 외

Recently deep learning-based methods have been applied in image compression and achieved many promising results. In this paper, we propose an improved hybrid layered image compression framework by combining deep learning…

Deep LearningImage CompressionMS-SSIMSSIM

Virtual Codec Supervised Re-Sampling Network for Image Compression

2018-06-22 · Lijun Zhao, Huihui Bai, Anhong Wang, Yao Zhao

In this paper, we propose an image re-sampling compression method by learning virtual codec network (VCN) to resolve the non-differentiable problem of quantization function for image compression. Here, the image re-sampl…

Dimensionality ReductionImage CompressionQuantization

Neural Network Compression using Transform Coding and Clustering

2018-05-18 · NIPS Workshop CDNNRIA 2018 · Thorsten Laude, Yannick Richter, Jörn Ostermann

With the deployment of neural networks on mobile devices and the necessity of transmitting neural networks over limited or expensive channels, the file size of the trained model was identified as bottleneck. In this pape…

ClusteringGeneral Classificationimage-classificationImage Classification+1