paper-with-me

홈 › Papers

Inpainting-based Video Compression in FullHD

2020-08-24 · Sarah Andris, Pascal Peter, Rahul Mohideen Kaja Mohideen, Joachim Weickert, Sebastian Hoffmann

Compression methods based on inpainting are an evolving alternative to classical transform-based codecs for still images. Attempts to apply these ideas to video compression are rare, since reaching real-time performance is very challenging. Therefore, current approaches focus on simplified frame-by-frame reconstructions that ignore temporal redundancies. As a remedy, we propose a highly efficient, real-time capable prediction and correction approach that fully relies on partial differential equations (PDEs) in all steps of the codec: Dense variational optic flow fields yield accurate motion-compensated predictions, while homogeneous diffusion inpainting is applied for intra prediction. To compress residuals, we introduce a new highly efficient block-based variant of pseudodifferential inpainting. Our novel architecture outperforms other inpainting-based video codecs in terms of both quality and speed. For the first time in inpainting-based video compression, we can decompress FullHD (1080p) videos in real-time with a fully CPU-based implementation, outperforming previous approaches by roughly one order of magnitude.

📄 PDF Abstract BibTeX arXiv:2008.10273

Code (0)

등록된 구현이 없습니다.

Tasks

CPUVideo Compression

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Deep Video Inpainting Detection

2021-01-26 · Peng Zhou, Ning Yu, Zuxuan Wu, Larry S. Davis 외

This paper studies video inpainting detection, which localizes an inpainted region in a video both spatially and temporally. In particular, we introduce VIDNet, Video Inpainting Detection Network, which contains a two-st…

DecoderVideo Inpainting

DNeRV: Modeling Inherent Dynamics via Difference Neural Representation for Videos

2023-04-13 · CVPR 2023 1 · Qi Zhao, M. Salman Asif, Zhan Ma

Existing implicit neural representation (INR) methods do not fully exploit spatiotemporal redundancies in videos. Index-based INRs ignore the content-specific spatial features and hybrid INRs ignore the contextual depend…

Video Compression

Compressing Flow Fields with Edge-aware Homogeneous Diffusion Inpainting

2020-04-29

In spite of the fact that efficient compression methods for dense two-dimensional flow fields would be very useful for modern video codecs, hardly any research has been performed in this area so far. Our paper addresses …

MotionAura: Generating High-Quality and Motion Consistent Videos using Discrete Diffusion

2024-10-10 · Onkar Susladkar, Jishu Sen Gupta, Chirag Sehgal, Sparsh Mittal 외

The spatio-temporal complexity of video data presents significant challenges in tasks such as compression, generation, and inpainting. We present four key contributions to address the challenges of spatiotemporal video p…

Denoisingparameter-efficient fine-tuningQuantizationText-to-Video Generation+3

Slovo: Russian Sign Language Dataset

2023-05-23 · Alexander Kapitanov, Karina Kvanchiani, Alexander Nagaev, Elizaveta Petrova

One of the main challenges of the sign language recognition task is the difficulty of collecting a suitable dataset due to the gap between hard-of-hearing and hearing societies. In addition, the sign language in each cou…

Sign Language Recognition