paper-with-me

홈 › Papers

Boosting CNN beyond Label in Inverse Problems

2019-06-18 · Eunju Cha, Jaeduck Jang, Junho Lee, Eunha Lee, Jong Chul Ye

Convolutional neural networks (CNN) have been extensively used for inverse problems. However, their prediction error for unseen test data is difficult to estimate a priori since the neural networks are trained using only selected data and their architecture are largely considered a blackbox. This poses a fundamental challenge to neural networks for unsupervised learning or improvement beyond the label. In this paper, we show that the recent unsupervised learning methods such as Noise2Noise, Stein's unbiased risk estimator (SURE)-based denoiser, and Noise2Void are closely related to each other in their formulation of an unbiased estimator of the prediction error, but each of them are associated with its own limitations. Based on these observations, we provide a novel boosting estimator for the prediction error. In particular, by employing combinatorial convolutional frame representation of encoder-decoder CNN and synergistically combining it with the batch normalization, we provide a close form formulation for the unbiased estimator of the prediction error that can be minimized for neural network training beyond the label. Experimental results show that the resulting algorithm, what we call Noise2Boosting, provides consistent improvement in various inverse problems under both supervised and unsupervised learning setting.

📄 PDF Abstract BibTeX arXiv:1906.07330

Code (0)

등록된 구현이 없습니다.

Tasks

DecoderPrediction

Similar Papers 제목 키워드 기반

BOOSTING ENCODER-DECODER CNN FOR INVERSE PROBLEMS

2019-09-25 · Eunju Cha, Jaeduck Jang, Junho Lee, Eunha Lee 외

Encoder-decoder convolutional neural networks (CNN) have been extensively used for various inverse problems. However, their prediction error for unseen test data is difficult to estimate a priori, since the neural …

DecoderDenoisingPrediction

ReGuidance: A Simple Diffusion Wrapper for Boosting Sample Quality on Hard Inverse Problems

2025-06-12 · Aayush Karan, Kulin Shah, Sitan Chen

There has been a flurry of activity around using pretrained diffusion models as informed data priors for solving inverse problems, and more generally around steering these models using reward models. Training-free method…

Super-Resolution

Pattern-aware Data Augmentation for Query Rewriting in Voice Assistant Systems

2020-12-21 · Yunmo Chen, Sixing Lu, Fan Yang, Xiaojiang Huang 외

Query rewriting (QR) systems are widely used to reduce the friction caused by errors in a spoken language understanding pipeline. However, the underlying supervised models require a large number of labeled pairs, and the…

Data AugmentationFrictionSpoken Language Understanding

Dimension-reduced KRnet maps for high-dimensional Bayesian inverse problems

2023-03-01 · Yani Feng, Kejun Tang, Xiaoliang Wan, Qifeng Liao

We present a dimension-reduced KRnet map approach (DR-KRnet) for high-dimensional Bayesian inverse problems, which is based on an explicit construction of a map that pushes forward the prior measure to the posterior meas…

DecoderVocal Bursts Intensity Prediction

Inverse analysis of granular flows using differentiable graph neural network simulator

2024-01-17 · Yongjin Choi, Krishna Kumar

Inverse problems in granular flows, such as landslides and debris flows, involve estimating material parameters or boundary conditions based on target runout profile. Traditional high-fidelity simulators for these invers…

Computational EfficiencyGraph Neural Network