Learned Video Compression via Joint Spatial-Temporal Correlation Exploration
Traditional video compression technologies have been developed over decades in pursuit of higher coding efficiency. Efficient temporal information representation plays a key role in video coding. Thus, in this paper, we propose to exploit the temporal correlation using both first-order optical flow and second-order flow prediction. We suggest an one-stage learning approach to encapsulate flow as quantized features from consecutive frames which is then entropy coded with adaptive contexts conditioned on joint spatial-temporal priors to exploit second-order correlations. Joint priors are embedded in autoregressive spatial neighbors, co-located hyper elements and temporal neighbors using ConvLSTM recurrently. We evaluate our approach for the low-delay scenario with High-Efficiency Video Coding (H.265/HEVC), H.264/AVC and another learned video compression method, following the common test settings. Our work offers the state-of-the-art performance, with consistent gains across all popular test sequences.
Code (0)
등록된 구현이 없습니다.
Tasks
Optical Flow EstimationVideo CompressionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Spatial-Temporal Transformer based Video Compression Framework
Learned video compression (LVC) has witnessed remarkable advancements in recent years. Similar as the traditional video coding, LVC inherits motion estimation/compensation, residual coding and other modules, all of which…
Motion EstimationPredictionVideo CompressionVideo Compression With Entropy-Constrained Neural Representations
Encoding videos as neural networks is a recently proposed approach that allows new forms of video processing. However, traditional techniques still outperform such neural video representation (NVR) methods for the ta…
QuantizationVideo CompressionPerceptual Learned Video Compression with Recurrent Conditional GAN
This paper proposes a Perceptual Learned Video Compression (PLVC) approach with recurrent conditional GAN. We employ the recurrent auto-encoder-based compression network as the generator, and most importantly, we propose…
Video CompressionKeep-or-Drop? Adaptive Tokenizer for Compact Video Representation
Latent diffusion models have emerged as a dominant framework for high-fidelity image and video synthesis, operating in compact latent spaces with variational autoencoders (VAEs) to enhance computational efficiency withou…
Computational EfficiencySpatial Decomposition and Temporal Fusion based Inter Prediction for Learned Video Compression
Video compression performance is closely related to the accuracy of inter prediction. It tends to be difficult to obtain accurate inter prediction for the local video regions with inconsistent motion and occlusion. Tradi…
Motion EstimationMS-SSIMPredictionSSIM+1