paper-with-me

홈 › Papers

Rethinking Skip Connections: Additive U-Net for Robust and Interpretable Denoising

2026-01-19 · Vikram R Lakkavalli arxiv

Skip connections are central to U-Net architectures for image denoising, but standard concatenation doubles channel dimensionality and obscures information flow, allowing uncontrolled noise transfer. We propose the Additive U-Net, which replaces concatenative skips with gated additive connections. Each skip pathway is scaled by a learnable non-negative scalar, offering explicit and interpretable control over encoder contributions while avoiding channel inflation. Evaluations on the Kodak-17 denoising benchmark show that Additive U-Net achieves competitive PSNR/SSIM at noise levels σ = 15, 25, 50, with robustness across kernel schedules and depths. Notably, effective denoising is achieved even without explicit down/up-sampling or forced hierarchies, as the model naturally learns a progression from high-frequency to band-pass to low-frequency features. These results position additive skips as a lightweight and interpretable alternative to concatenation, enabling both efficient design and a clearer understanding of multi-scale information transfer in reconstruction networks.

📄 PDF Abstract BibTeX arXiv:2601.13208

Code (0)

등록된 구현이 없습니다.

Tasks

Image Denoising

Similar Papers 제목 키워드 기반

Multi-Task Learning with Additive U-Net for Image Denoising and Classification

2026-02-13 · Vikram Lakkavalli, Neelam Sinha arxiv

We investigate additive skip fusion in U-Net architectures for image denoising and denoising-centric multi-task learning (MTL). By replacing concatenative skips with gated additive fusion, the proposed Additive U-Net (Ad…

Multi-Task LearningImage Denoising

Rethinking Skip Connections in Encoder-decoder Networks for Monocular Depth Estimation

2022-08-29 · Zhitong Lai, Haichao Sun, Rui Tian, Nannan Ding 외

Skip connections are fundamental units in encoder-decoder networks, which are able to improve the feature propagtion of the neural networks. However, most methods with skip connections just connected features with the sa…

DecoderDepth EstimationMonocular Depth Estimation

Rethinking Skip Connections in Spiking Neural Networks with Time-To-First-Spike Coding

2023-12-01 · Youngeun Kim, Adar Kahana, Ruokai Yin, Yuhang Li 외

Time-To-First-Spike (TTFS) coding in Spiking Neural Networks (SNNs) offers significant advantages in terms of energy efficiency, closely mimicking the behavior of biological neurons. In this work, we delve into the role …

Denoising Auto-encoder with Recurrent Skip Connections and Residual Regression for Music Source Separation

2018-07-05 · Jen-Yu Liu, Yi-Hsuan Yang

Convolutional neural networks with skip connections have shown good performance in music source separation. In this work, we propose a denoising Auto-encoder with Recurrent skip Connections (ARC). We use 1D convolution a…

ARCDenoisingMusic Source Separationregression

Impact of Bottleneck Layers and Skip Connections on the Generalization of Linear Denoising Autoencoders

2025-05-30 · Jonghyun Ham, Maximilian Fleissner, Debarghya Ghoshdastidar

Modern deep neural networks exhibit strong generalization even in highly overparameterized regimes. Significant progress has been made to understand this phenomenon in the context of supervised learning, but for unsuperv…

Denoising