Adversarial Video Compression Guided by Soft Edge Detection
We propose a video compression framework using conditional Generative Adversarial Networks (GANs). We rely on two encoders: one that deploys a standard video codec and another which generates low-level maps via a pipeline of down-sampling, a newly devised soft edge detector, and a novel lossless compression scheme. For decoding, we use a standard video decoder as well as a neural network based one, which is trained using a conditional GAN. Recent "deep" approaches to video compression require multiple videos to pre-train generative networks to conduct interpolation. In contrast to this prior work, our scheme trains a generative decoder on pairs of a very limited number of key frames taken from a single video and corresponding low-level maps. The trained decoder produces reconstructed frames relying on a guidance of low-level maps, without any interpolation. Experiments on a diverse set of 131 videos demonstrate that our proposed GAN-based compression engine achieves much higher quality reconstructions at very low bitrates than prevailing standard codecs such as H.264 or HEVC.
Code (0)
등록된 구현이 없습니다.
Tasks
DecoderEdge DetectionVideo CompressionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
NetFlick: Adversarial Flickering Attacks on Deep Learning Based Video Compression
Video compression plays a significant role in IoT devices for the efficient transport of visual data while satisfying all underlying bandwidth constraints. Deep learning-based video compression methods are rapidly replac…
Deep LearningVideo ClassificationVideo CompressionEnhancing Adversarial Training with Prior Knowledge Distillation for Robust Image Compression
Deep neural network-based image compression (NIC) has achieved excellent performance, but NIC method models have been shown to be susceptible to backdoor attacks. Adversarial training has been validated in image compress…
Backdoor AttackImage CompressionKnowledge DistillationVideo Compression Coding via Colorization: A Generative Adversarial Network (GAN)-Based Approach
Under the limited storage, computing and network bandwidth resources, the video compression coding technology plays an important role for visual communication. To efficiently compress raw video data, a colorization-based…
ColorizationDecoderGenerative Adversarial NetworkVideo CompressionAdversarial Distortion for Learned Video Compression
In this paper, we present a novel adversarial lossy video compression model. At extremely low bit-rates, standard video coding schemes suffer from unpleasant reconstruction artifacts such as blocking, ringing etc. Existi…
BlockingMS-SSIMSSIMVideo CompressionRoVISQ: Reduction of Video Service Quality via Adversarial Attacks on Deep Learning-based Video Compression
Video compression plays a crucial role in video streaming and classification systems by maximizing the end-user quality of experience (QoE) at a given bandwidth budget. In this paper, we conduct the first systematic stud…
Adversarial AttackClassificationDenoisingVideo Classification+2