Spatio-Temporal Deformable Attention Network for Video Deblurring
The key success factor of the video deblurring methods is to compensate for the blurry pixels of the mid-frame with the sharp pixels of the adjacent video frames. Therefore, mainstream methods align the adjacent frames based on the estimated optical flows and fuse the alignment frames for restoration. However, these methods sometimes generate unsatisfactory results because they rarely consider the blur levels of pixels, which may introduce blurry pixels from video frames. Actually, not all the pixels in the video frames are sharp and beneficial for deblurring. To address this problem, we propose the spatio-temporal deformable attention network (STDANet) for video delurring, which extracts the information of sharp pixels by considering the pixel-wise blur levels of the video frames. Specifically, STDANet is an encoder-decoder network combined with the motion estimator and spatio-temporal deformable attention (STDA) module, where motion estimator predicts coarse optical flows that are used as base offsets to find the corresponding sharp pixels in STDA module. Experimental results indicate that the proposed STDANet performs favorably against state-of-the-art methods on the GoPro, DVD, and BSD datasets.
Code (1)
Tasks
DeblurringDecoderVideo DeblurringMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Deformable VisTR: Spatio temporal deformable attention for video instance segmentation
Video instance segmentation (VIS) task requires classifying, segmenting, and tracking object instances over all frames in a video clip. Recently, VisTR has been proposed as end-to-end transformer-based VIS framework, whi…
GPUInstance SegmentationSemantic SegmentationVideo Instance SegmentationEDVR: Video Restoration with Enhanced Deformable Convolutional Networks
Video restoration tasks, including super-resolution, deblurring, etc, are drawing increasing attention in the computer vision community. A challenging benchmark named REDS is released in the NTIRE19 Challenge. This new b…
DeblurringSuper-ResolutionVideo EnhancementVideo Restoration+1Gated Spatio-Temporal Attention-Guided Video Deblurring
Video deblurring remains a challenging task due to the complexity of spatially and temporally varying blur. Most of the existing works depend on implicit or explicit alignment for temporal information fusion, which e…
DeblurringVideo DeblurringDeformable 3D Convolution for Video Super-Resolution
The spatio-temporal information among video sequences is significant for video super-resolution (SR). However, the spatio-temporal information cannot be fully used by existing video SR methods since spatial feature extra…
Motion CompensationSuper-ResolutionVideo Super-ResolutionSpike-guided Motion Deblurring with Unknown Modal Spatiotemporal Alignment
The traditional frame-based cameras that rely on exposure windows for imaging experience motion blur in high-speed scenarios. Frame-based deblurring methods lack reliable motion cues to restore sharp images under ext…
DeblurringImage Deblurring