paper-with-me

Papers

Self-Supervised Non-Uniform Kernel Estimation With Flow-Based Motion Prior for Blind Image Deblurring

2023-01-01 · CVPR 2023 1 · Zhenxuan Fang, Fangfang Wu, Weisheng Dong, Xin Li, Jinjian Wu, Guangming Shi

Many deep learning-based solutions to blind image deblurring estimate the blur representation and reconstruct the target image from its blurry observation. However, these methods suffer from severe performance degradation in real-world scenarios because they ignore important prior information about motion blur (e.g., real-world motion blur is diverse and spatially varying). Some methods have attempted to explicitly estimate non-uniform blur kernels by CNNs, but accurate estimation is still challenging due to the lack of ground truth about spatially varying blur kernels in real-world images. To address these issues, we propose to represent the field of motion blur kernels in a latent space by normalizing flows, and design CNNs to predict the latent codes instead of motion kernels. To further improve the accuracy and robustness of non-uniform kernel estimation, we introduce uncertainty learning into the process of estimating latent codes and propose a multi-scale kernel attention module to better integrate image features with estimated kernels. Extensive experimental results, especially on real-world blur datasets, demonstrate that our method achieves state-of-the-art results in terms of both subjective and objective quality as well as excellent generalization performance for non-uniform image deblurring. The code is available at https://see.xidian.edu.cn/faculty/wsdong/Projects/UFPNet.htm.

📄 PDF Abstract BibTeX

Code (1)

fangzhenxuan/ufpdeblur 공식 구현 pytorch

Tasks

Blind Image DeblurringDeblurringImage Deblurring

Similar Papers 제목 키워드 기반

Revisiting Optical Flow Estimation in 360 Videos

2020-10-15 · Keshav Bhandari, Ziliang Zong, Yan Yan

Nowadays 360 video analysis has become a significant research topic in the field since the appearance of high-quality and low-cost 360 wearable devices. In this paper, we propose a novel LiteFlowNet360 architecture for 3…

Data AugmentationDomain AdaptationOptical Flow Estimation

Self-supervised learning with rotation-invariant kernels

2022-07-28 · Léon Zheng, Gilles Puy, Elisa Riccietti, Patrick Pérez 외

We introduce a regularization loss based on kernel mean embeddings with rotation-invariant kernels on the hypersphere (also known as dot-product kernels) for self-supervised learning of image representations. Besides bei…

Self-Supervised Learning

Better Correlation and Robustness: A Distribution-Balanced Self-Supervised Learning Framework for Automatic Dialogue Evaluation

2023-09-21 · NeurIPS 2023 11

Turn-level dialogue evaluation models (TDEMs), using self-supervised learning (SSL) framework, have achieved state-of-the-art performance in open-domain dialogue evaluation. However, these models inevitably face two pote…

Self-Supervised Deep Blind Video Super-Resolution

2022-01-19 · Haoran Bai, Jinshan Pan

Existing deep learning-based video super-resolution (SR) methods usually depend on the supervised learning approach, where the training data is usually generated by the blurring operation with known or predefined kernels…

Optical Flow EstimationSelf-Supervised LearningSuper-ResolutionVideo Restoration+1

Adversarial Self-Supervised Scene Flow Estimation

2020-11-01 · Victor Zuanazzi, Joris van Vugt, Olaf Booij, Pascal Mettes

This work proposes a metric learning approach for self-supervised scene flow estimation. Scene flow estimation is the task of estimating 3D flow vectors for consecutive 3D point clouds. Such flow vectors are fruitful, \e…

Metric LearningScene Flow EstimationSelf-supervised Scene Flow EstimationTriplet