Learning Task-Oriented Flows to Mutually Guide Feature Alignment in Synthesized and Real Video Denoising
Video denoising aims at removing noise from videos to recover clean ones. Some existing works show that optical flow can help the denoising by exploiting the additional spatial-temporal clues from nearby frames. However, the flow estimation itself is also sensitive to noise, and can be unusable under large noise levels. To this end, we propose a new multi-scale refined optical flow-guided video denoising method, which is more robust to different noise levels. Our method mainly consists of a denoising-oriented flow refinement (DFR) module and a flow-guided mutual denoising propagation (FMDP) module. Unlike previous works that directly use off-the-shelf flow solutions, DFR first learns robust multi-scale optical flows, and FMDP makes use of the flow guidance by progressively introducing and refining more flow information from low resolution to high resolution. Together with real noise degradation synthesis, the proposed multi-scale flow-guided denoising network achieves state-of-the-art performance on both synthetic Gaussian denoising and real video denoising. The codes will be made publicly available.
Code (0)
등록된 구현이 없습니다.
Tasks
DenoisingOptical Flow EstimationVideo DenoisingSimilar Papers 제목 키워드 기반
BoilerBot: A reliable task-oriented chatbot enhanced with large language models
This paper outlines the design and deployment of BoilerBot: a task-oriented multi- modal conversational agent developed for the Alexa Prize TaskBot 2 competition. BoilerBot features flexible response generation, leveragi…
ChatbotResponse GenerationCycle In Cycle Generative Adversarial Networks for Keypoint-Guided Image Generation
In this work, we propose a novel Cycle In Cycle Generative Adversarial Network (C$^2$GAN) for the task of keypoint-guided image generation. The proposed C$^2$GAN is a cross-modal framework exploring a joint exploitation …
Generative Adversarial NetworkImage GenerationUnsupervised Flow Discovery from Task-oriented Dialogues
The design of dialogue flows is a critical but time-consuming task when developing task-oriented dialogue (TOD) systems. We propose an approach for the unsupervised discovery of flows from dialogue history, thus making t…
Semantic SimilaritySemantic Textual SimilarityDeep Goal-Oriented Clustering
Clustering and prediction are two primary tasks in the fields of unsupervised and supervised learning, respectively. Although much of the recent advances in machine learning have been centered around those two tasks, the…
ClusteringPredictionWorkflow-Guided Response Generation for Task-Oriented Dialogue
Task-oriented dialogue (TOD) systems aim to achieve specific goals through interactive dialogue. Such tasks usually involve following specific workflows, i.e. executing a sequence of actions in a particular order. While …
Reinforcement Learning (RL)Response Generation