Video Super-Resolution via Deep Draft-Ensemble Learning
We propose a new direction for fast video super-resolution (VideoSR) via a SR draft ensemble, which is defined as the set of high-resolution patch candidates before final image deconvolution. Our method contains two main components -- i.e., SR draft ensemble generation and its optimal reconstruction. The first component is to renovate traditional feedforward reconstruction pipeline and greatly enhance its ability to compute different super resolution results considering large motion variation and possible errors arising in this process. Then we combine SR drafts through the nonlinear process in a deep convolutional neural network (CNN). We analyze why this framework is proposed and explain its unique advantages compared to previous iterative methods to update different modules in passes. Promising experimental results are shown on natural video sequences.
Code (0)
등록된 구현이 없습니다.
Tasks
Ensemble LearningImage DeconvolutionSuper-ResolutionVideo Super-ResolutionSimilar Papers 제목 키워드 기반
DraftAttention: Fast Video Diffusion via Low-Resolution Attention Guidance
Diffusion transformer-based video generation models (DiTs) have recently attracted widespread attention for their excellent generation quality. However, their computational cost remains a major bottleneck-attention alone…
Video GenerationAdapting Image Super-Resolution State-of-the-arts and Learning Multi-model Ensemble for Video Super-Resolution
Recently, image super-resolution has been widely studied and achieved significant progress by leveraging the power of deep convolutional neural networks. However, there has been limited advancement in video super-resolut…
Image Super-ResolutionSuper-ResolutionVideo Super-ResolutionTABED: Test-Time Adaptive Ensemble Drafting for Robust Speculative Decoding in LVLMs
Speculative decoding (SD) has proven effective for accelerating LLM inference by quickly generating draft tokens and verifying them in parallel. However, SD remains largely unexplored for Large Vision-Language Models (LV…
From Draft to Draft-Free: One-Step Video Object Removal via Privileged Distillation and Fast Planting
Video object removal is a fundamental yet challenging task in video editing. Despite recent progress, existing methods typically fall into two categories. Traditional approaches based on optical flow or attention mechani…
Video GenerationPrecipitation Downscaling with Spatiotemporal Video Diffusion
In climate science and meteorology, high-resolution local precipitation (rain and snowfall) predictions are limited by the computational costs of simulation-based methods. Statistical downscaling, or super-resolution, is…
Optical Flow EstimationSuper-Resolution