paper-with-me

홈 › Papers

BOOSTING ENCODER-DECODER CNN FOR INVERSE PROBLEMS

2019-09-25 · Eunju Cha, Jaeduck Jang, Junho Lee, Eunha Lee, Jong Chul Ye

Encoder-decoder convolutional neural networks (CNN) have been extensively used for various inverse problems. However, their prediction error for unseen test data is difficult to estimate a priori, since the neural networks are trained using only selected data and their architectures are largely considered blackboxes. This poses a fundamental challenge in improving the performance of neural networks. Recently, it was shown that Stein’s unbiased risk estimator (SURE) can be used as an unbiased estimator of the prediction error for denoising problems. However, the computation of the divergence term in SURE is difficult to implement in a neural network framework, and the condition to avoid trivial identity mapping is not well defined. In this paper, inspired by the finding that an encoder-decoder CNN can be expressed as a piecewise linear representation, we provide a close form expression of the unbiased estimator for the prediction error. The close form representation leads to a novel boosting scheme to prevent a neural network from converging to an identity mapping so that it can enhance the performance. Experimental results show that the proposed algorithm provides consistent improvement in various inverse problems.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

DecoderDenoisingPrediction

Similar Papers 제목 키워드 기반

Boosting CNN beyond Label in Inverse Problems

2019-06-18 · Eunju Cha, Jaeduck Jang, Junho Lee, Eunha Lee 외

Convolutional neural networks (CNN) have been extensively used for inverse problems. However, their prediction error for unseen test data is difficult to estimate a priori since the neural networks are trained using only…

DecoderPrediction

Improving Generalization of Sequence Encoder-Decoder Networks for Inverse Imaging of Cardiac Transmembrane Potential

2018-10-12 · Sandesh Ghimire, Prashnna Kumar Gyawali, John L. Sapp, Milan Horacek 외

Deep learning models have shown state-of-the-art performance in many inverse reconstruction problems. However, it is not well understood what properties of the latent representation may improve the generalization ability…

DecoderLearning Theory

Goal-oriented Uncertainty Quantification for Inverse Problems via Variational Encoder-Decoder Networks

2023-04-17 · Babak Maboudi Afkham, Julianne Chung, Matthias Chung

In this work, we describe a new approach that uses variational encoder-decoder (VED) networks for efficient goal-oriented uncertainty quantification for inverse problems. Contrary to standard inverse problems, these appr…

DecoderUncertainty Quantification

Exploiting Invertible Decoders for Unsupervised Sentence Representation Learning

2018-09-08 · ACL 2019 7 · Shuai Tang, Virginia R. de Sa

The encoder-decoder models for unsupervised sentence representation learning tend to discard the decoder after being trained on a large unlabelled corpus, since only the encoder is needed to map the input sentence into a…

DecoderRepresentation LearningSentence

SERNet-Former: Semantic Segmentation by Efficient Residual Network with Attention-Boosting Gates and Attention-Fusion Networks

2024-01-28 · Serdar Erisen

Improving the efficiency of state-of-the-art methods in semantic segmentation requires overcoming the increasing computational cost as well as issues such as fusing semantic information from global and local contexts. Ba…

2D Semantic SegmentationDecoderSemantic Segmentation