Improved Motion Plane Adaptive 360-Degree Video Compression Using Affine Motion Models
Efficient compression of 360-degree video content requires the application of advanced motion models for interframe prediction. The Motion Plane Adaptive (MPA) motion model projects the frames on multiple perspective planes in the 3D space. It improves the motion compensation by estimating the motion on those planes with a translational diamond search. In this work, we enhance this motion model with an affine parameterization and motion estimation method. Thereby, we find a feasible trade-off between the quality of the reconstructed frames and the computational cost. The affine motion estimation is hereby done with the inverse compositional Lucas-Kanade algorithm. With the proposed method, it is possible to improve the motion compensation significantly, so that the motion compensated frame has a Weighted-to-Spherically-uniform Peak Signal-to-Noise Ratio (WS-PSNR) which is about 1.6 dB higher than with the conventional MPA. In a basic video codec, the improved inter prediction can lead to Bj{\o}ntegaard Delta (BD) rate savings between 9 % and 35 % depending on the block size (BS) and number of motion parameters.
Code (0)
등록된 구현이 없습니다.
Tasks
Motion CompensationMotion EstimationVideo CompressionSimilar Papers 제목 키워드 기반
Motion-Plane-Adaptive Inter Prediction in 360-Degree Video Coding
Inter prediction is one of the key technologies enabling the high compression efficiency of modern video coding standards. 360-degree video needs to be mapped to the 2D image plane prior to coding in order to allow compr…
PredictionMotionZero:Exploiting Motion Priors for Zero-shot Text-to-Video Generation
Zero-shot Text-to-Video synthesis generates videos based on prompts without any videos. Without motion information from videos, motion priors implied in prompts are vital guidance. For example, the prompt "airplane landi…
DisentanglementText-to-Video GenerationVideo GenerationZero-shot Text-to-Video GenerationMotion Plane Adaptive Motion Modeling for Spherical Video Coding in H.266/VVC
Motion compensation is one of the key technologies enabling the high compression efficiency of modern video coding standards. To allow compression of spherical video content, special mapping functions are required to pro…
Motion CompensationA Novel Viewport-Adaptive Motion Compensation Technique for Fisheye Video
Although fisheye cameras are in high demand in many application areas due to their large field of view, many image and video signal processing tasks such as motion compensation suffer from the introduced strong radial di…
Motion CompensationGeometry-Corrected Geodesic Motion Modeling with Per-Frame Camera Motion for 360-Degree Video Compression
The large amounts of data associated with 360-degree video require highly effective compression techniques for efficient storage and distribution. The development of improved motion models for 360-degree motion compensat…
Motion CompensationVideo Compression