paper-with-me

홈 › Papers

Deep Video Frame Interpolation using Cyclic Frame Generation

2019-01-27 · AAAI 2019 1 · Yu-Lun Liu, Yi-Tung Liao, Yen-Yu Lin, Yung-Yu Chuang1, 2

Video frame interpolation algorithms predict intermediate frames to produce videos with higher frame rates and smooth view transitions given two consecutive frames as inputs. We propose that: synthesized frames are more reliable if they can be used to reconstruct the input frames with high quality. Based on this idea, we introduce a new loss term, the cycle consistency loss. The cycle consistency loss can better utilize the training data to not only enhance the interpolation results, but also maintain the performance better with less training data. It can be integrated into any frame interpolation network and trained in an end-to-end manner. In addition to the cycle consistency loss, we propose two extensions: motion linearity loss and edge-guided training. The motion linearity loss approximates the motion between two input frames to be linear and regularizes the training. By applying edge-guided training, we further improve results by integrating edge information into training. Both qualitative and quantitative experiments demonstrate that our model outperforms the state-of-the-art methods.

📄 PDF Abstract BibTeX

Code (1)

alex04072000/CyclicGen tf

Tasks

Optical Flow EstimationVideo Frame Interpolation

Methods 이 논문이 사용한 방법론

Cycle Consistency Loss Cycle Consistency Loss is a type of loss used for generative adversarial networks that performs unpaired image-to-image translation. It was introduced with the…

Similar Papers 제목 키워드 기반

Blurry Video Frame Interpolation

2020-02-27 · CVPR 2020 6 · Wang Shen, Wenbo Bao, Guangtao Zhai, Li Chen 외

Existing works reduce motion blur and up-convert frame rate through two separate ways, including frame deblurring and frame interpolation. However, few studies have approached the joint video enhancement problem, namely …

DeblurringVideo EnhancementVideo Frame Interpolation

Video Motion Graphs

2025-03-26 · Haiyang Liu, Zhan Xu, Fa-Ting Hong, Hsin-Ping Huang 외

We present Video Motion Graphs, a system designed to generate realistic human motion videos. Using a reference video and conditional signals such as music or motion tags, the system synthesizes new videos by first retrie…

Motion InterpolationVideo Frame InterpolationVideo Generation

LIFI: Towards Linguistically Informed Frame Interpolation

2020-10-30 · Aradhya Neeraj Mathur, Devansh Batra, Yaman Kumar, Rajiv Ratn Shah 외

In this work, we explore a new problem of frame interpolation for speech videos. Such content today forms the major form of online communication. We try to solve this problem by using several deep learning video generati…

Video Generation

ViBiDSampler: Enhancing Video Interpolation Using Bidirectional Diffusion Sampler

2024-10-08 · Serin Yang, Taesung Kwon, Jong Chul Ye

Recent progress in large-scale text-to-video (T2V) and image-to-video (I2V) diffusion models has greatly enhanced video generation, especially in terms of keyframe interpolation. However, current image-to-video diffusion…

GPUVideo Generation

Coupled Video Frame Interpolation and Encoding with Hybrid Event Cameras for Low-Power High-Framerate Video

2025-03-28 · Hidekazu Takahashi, Takefumi Nagumo, Kensei Jo, Aumiller Andreas 외

Every generation of mobile devices strives to capture video at higher resolution and frame rate than previous ones. This quality increase also requires additional power and computation to capture and encode high-quality …

Event-based visionVideo Frame Interpolation