paper-with-me

홈 › Papers

AKDT: Adaptive Kernel Dilation Transformer for Effective Image Denoising

2025-02-26 · VISAPP 2025 2 · Alexandru Brateanu, Raul Balmez, Adrian Avram, Ciprian Orhei

Image denoising is a fundamental yet challenging task, especially when dealing with high-resolution images and complex noise patterns. Most existing methods rely on standard Transformer architectures, which often suffer from high computational complexity and limited adaptability to varying noise levels. In this paper, we introduce the Adaptive Kernel Dilation Transformer (AKDT), a novel Transformer-based model that fully harnesses the power of learnable dilation rates within convolutions. AKDT consists of several layers and custom-designed blocks, including our novel Learnable Dilation Rate (LDR) module, which is utilized to construct a Noise Estimator module (NE). At the core of AKDT, the NE is seamlessly integrated within standard Transformer components to form the Noise-Guided Feed-Forward Network (NG-FFN) and Noise-Guided Multi-Headed Self-Attention (NG-MSA). These noise-modulated Transformer components enable the model to achieve unparalleled denoising performance while significantly reducing computational costs. Extensive experiments across multiple image denoising benchmarks demonstrate that AKDT sets a new state-of-the-art, effectively handling both real and synthetic noise. The source code and pre-trained models are publicly available at https://github.com/albrateanu/AKDT.

📄 PDF Abstract BibTeX

Code (1)

albrateanu/AKDT pytorch

Tasks

Color Image DenoisingDenoisingImage Denoising

Methods 이 논문이 사용한 방법론

Attention 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Residual Connection 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Multi-Head Attention 설명 없음
Position-Wise Feed-Forward Layer 설명 없음

Similar Papers 제목 키워드 기반

Diversifying and Expanding Frequency-Adaptive Convolution Kernels for Sound Event Detection

2024-06-08 · Hyeonuk Nam, Seong-Hu Kim, Deokki Min, Junhyeok Lee 외

Frequency dynamic convolution (FDY conv) has shown the state-of-the-art performance in sound event detection (SED) using frequency-adaptive kernels obtained by frequency-varying combination of basis kernels. However, FDY…

Event DetectionSound Event Detection

Generalized Dilation Neural Networks

2019-05-08 · Gavneet Singh Chadha, Jan Niclas Reimann, Andreas Schwung

Vanilla convolutional neural networks are known to provide superior performance not only in image recognition tasks but also in natural language processing and time series analysis. One of the strengths of convolutional …

Time SeriesTime Series Analysis

Deep 3D Pan via adaptive "t-shaped" convolutions with global and local adaptive dilations

2019-10-02 · Juan Luis Gonzalez Bello, Munchurl Kim

Recent advances in deep learning have shown promising results in many low-level vision tasks. However, solving the single-image-based view synthesis is still an open problem. In particular, the generation of new images a…

Depth EstimationMonocular Depth EstimationSSIMUnsupervised Monocular Depth Estimation

Deep 3D Pan via Local adaptive "t-shaped" convolutions with global and local adaptive dilations

2020-05-01 · ICLR 2020 1 · Juan Luis Gonzalez Bello, Munchurl Kim

Recent advances in deep learning have shown promising results in many low-level vision tasks. However, solving the single-image-based view synthesis is still an open problem. In particular, the generation of new images …

Depth EstimationMonocular Depth EstimationSSIMUnsupervised Monocular Depth Estimation

D-Net: Dynamic Large Kernel with Dynamic Feature Fusion for Volumetric Medical Image Segmentation

2024-03-15 · Jin Yang, Peijie Qiu, Yichi Zhang, Daniel S. Marcus 외

Hierarchical transformers have achieved significant success in medical image segmentation due to their large receptive field and capabilities of effectively leveraging global long-range contextual information. Convolutio…

Brain Tumor SegmentationImage SegmentationMedical Image SegmentationOrgan Segmentation+4