Rethinking Skip Connections: Additive U-Net for Robust and Interpretable Denoising
Skip connections are central to U-Net architectures for image denoising, but standard concatenation doubles channel dimensionality and obscures information flow, allowing uncontrolled noise transfer. We propose the Additive U-Net, which replaces concatenative skips with gated additive connections. Each skip pathway is scaled by a learnable non-negative scalar, offering explicit and interpretable control over encoder contributions while avoiding channel inflation. Evaluations on the Kodak-17 denoising benchmark show that Additive U-Net achieves competitive PSNR/SSIM at noise levels σ = 15, 25, 50, with robustness across kernel schedules and depths. Notably, effective denoising is achieved even without explicit down/up-sampling or forced hierarchies, as the model naturally learns a progression from high-frequency to band-pass to low-frequency features. These results position additive skips as a lightweight and interpretable alternative to concatenation, enabling both efficient design and a clearer understanding of multi-scale information transfer in reconstruction networks.
Code (0)
등록된 구현이 없습니다.
Tasks
Image DenoisingSimilar Papers 제목 키워드 기반
Multi-Task Learning with Additive U-Net for Image Denoising and Classification
We investigate additive skip fusion in U-Net architectures for image denoising and denoising-centric multi-task learning (MTL). By replacing concatenative skips with gated additive fusion, the proposed Additive U-Net (Ad…
Multi-Task LearningImage DenoisingRethinking Skip Connections in Encoder-decoder Networks for Monocular Depth Estimation
Skip connections are fundamental units in encoder-decoder networks, which are able to improve the feature propagtion of the neural networks. However, most methods with skip connections just connected features with the sa…
DecoderDepth EstimationMonocular Depth EstimationRethinking Skip Connections in Spiking Neural Networks with Time-To-First-Spike Coding
Time-To-First-Spike (TTFS) coding in Spiking Neural Networks (SNNs) offers significant advantages in terms of energy efficiency, closely mimicking the behavior of biological neurons. In this work, we delve into the role …
Denoising Auto-encoder with Recurrent Skip Connections and Residual Regression for Music Source Separation
Convolutional neural networks with skip connections have shown good performance in music source separation. In this work, we propose a denoising Auto-encoder with Recurrent skip Connections (ARC). We use 1D convolution a…
ARCDenoisingMusic Source SeparationregressionImpact of Bottleneck Layers and Skip Connections on the Generalization of Linear Denoising Autoencoders
Modern deep neural networks exhibit strong generalization even in highly overparameterized regimes. Significant progress has been made to understand this phenomenon in the context of supervised learning, but for unsuperv…
Denoising