paper-with-me

Papers

Learning Deformable Kernels for Image and Video Denoising

2019-04-15 · Xiangyu Xu, Muchen Li, Wenxiu Sun

Most of the classical denoising methods restore clear results by selecting and averaging pixels in the noisy input. Instead of relying on hand-crafted selecting and averaging strategies, we propose to explicitly learn this process with deep neural networks. Specifically, we propose deformable 2D kernels for image denoising where the sampling locations and kernel weights are both learned. The proposed kernel naturally adapts to image structures and could effectively reduce the oversmoothing artifacts. Furthermore, we develop 3D deformable kernels for video denoising to more efficiently sample pixels across the spatial-temporal space. Our method is able to solve the misalignment issues of large motion from dynamic scenes. For better training our video denoising model, we introduce the trilinear sampler and a new regularization term. We demonstrate that the proposed method performs favorably against the state-of-the-art image and video denoising approaches on both synthetic and real-world data.

📄 PDF Abstract BibTeX arXiv:1904.06903

Code (2)

jojo23333/STPAN 공식 구현 pytorch
z-bingo/Deformable-Kernels-For-Video-Denoising pytorch

Tasks

DenoisingImage DenoisingVideo Denoising

Similar Papers 제목 키워드 기반

A Constrained Deformable Convolutional Network for Efficient Single Image Dynamic Scene Blind Deblurring with Spatially-Variant Motion Blur Kernels Estimation

2022-08-23 · Shu Tang, Yang Wu, Hongxing Qin, Xianzhong Xie 외

Most existing deep-learning-based single image dynamic scene blind deblurring (SIDSBD) methods usually design deep networks to directly remove the spatially-variant motion blurs from one inputted motion blurred image, wi…

DeblurringImage Restoration

Learned Video Compression via Heterogeneous Deformable Compensation Network

2022-07-11 · Huairui Wang, Zhenzhong Chen, Chang Wen Chen

Learned video compression has recently emerged as an essential research topic in developing advanced video compression technologies, where motion compensation is considered one of the most challenging issues. In this pap…

Motion CompensationOptical Flow EstimationVideo Compression

TDAN: Temporally Deformable Alignment Network for Video Super-Resolution

2018-12-07 · Yapeng Tian, Yulun Zhang, Yun Fu, Chenliang Xu

Video super-resolution (VSR) aims to restore a photo-realistic high-resolution (HR) video frame from both its corresponding low-resolution (LR) frame (reference frame) and multiple neighboring frames (supporting frames).…

Optical Flow EstimationSuper-ResolutionVideo Super-Resolution

Underwater Fish Tracking for Moving Cameras based on Deformable Multiple Kernels

2016-03-05 · Meng-Che Chuang, Jenq-Neng Hwang, Jian-Hui Ye, Shih-Chia Huang 외

Fishery surveys that call for the use of single or multiple underwater cameras have been an emerging technology as a non-extractive mean to estimate the abundance of fish stocks. Tracking live fish in an open aquatic env…

Temporal Modulation Network for Controllable Space-Time Video Super-Resolution

2021-04-21 · CVPR 2021 1 · Gang Xu, Jun Xu, Zhen Li, Liang Wang 외

Space-time video super-resolution (STVSR) aims to increase the spatial and temporal resolutions of low-resolution and low-frame-rate videos. Recently, deformable convolution based methods have achieved promising STVSR pe…

Space-time Video Super-resolutionSuper-ResolutionVideo Super-Resolution