Learning Spatial and Spatio-Temporal Pixel Aggregations for Image and Video Denoising
Existing denoising methods typically restore clear results by aggregating pixels from the noisy input. Instead of relying on hand-crafted aggregation schemes, we propose to explicitly learn this process with deep neural networks. We present a spatial pixel aggregation network and learn the pixel sampling and averaging strategies for image denoising. The proposed model naturally adapts to image structures and can effectively improve the denoised results. Furthermore, we develop a spatio-temporal pixel aggregation network for video denoising to efficiently sample pixels across the spatio-temporal space. Our method is able to solve the misalignment issues caused by large motion in dynamic scenes. In addition, we introduce a new regularization term for effectively training the proposed video denoising model. We present extensive analysis of the proposed method and demonstrate that our model performs favorably against the state-of-the-art image and video denoising approaches on both synthetic and real-world data.
Code (3)
Tasks
DenoisingImage DenoisingVideo DenoisingSimilar Papers 제목 키워드 기반
OBSUM: An object-based spatial unmixing model for spatiotemporal fusion of remote sensing images
Spatiotemporal fusion aims to improve both the spatial and temporal resolution of remote sensing images, thus facilitating time-series analysis at a fine spatial scale. However, there are several important issues that li…
ObjectTime SeriesTime Series AnalysisSpatio-Temporal driven Attention Graph Neural Network with Block Adjacency matrix (STAG-NN-BA)
Despite the recent advances in deep neural networks, standard convolutional kernels limit the applications of these networks to the Euclidean domain only. Considering the geodesic nature of the measurement of the earth's…
Graph AttentionGraph Neural NetworkImage SegmentationRAG+2Learning Spatio-Temporal Aggregations for Large-Scale Capacity Expansion Problems
Effective investment planning decisions are crucial to ensure cyber-physical infrastructures satisfy performance requirements over an extended time horizon. Computing these decisions often requires solving Capacity Expan…
Super-resolution of spatiotemporal event-stream image captured by the asynchronous temporal contrast vision sensor
Super-resolution (SR) is a useful technology to generate a high-resolution (HR) visual output from the low-resolution (LR) visual inputs overcoming the physical limitations of the cameras. However, SR has not been applie…
Event-based visionSuper-ResolutionLearning semantical dynamics and spatiotemporal collaboration for human pose estimation in video
Temporal modeling and spatio-temporal collaboration are pivotal techniques for video-based human pose estimation. Most state-of-the-art methods adopt optical flow or temporal difference, learning local visual content cor…
Optical Flow EstimationPose Estimation