AKDT: Adaptive Kernel Dilation Transformer for Effective Image Denoising
Image denoising is a fundamental yet challenging task, especially when dealing with high-resolution images and complex noise patterns. Most existing methods rely on standard Transformer architectures, which often suffer from high computational complexity and limited adaptability to varying noise levels. In this paper, we introduce the Adaptive Kernel Dilation Transformer (AKDT), a novel Transformer-based model that fully harnesses the power of learnable dilation rates within convolutions. AKDT consists of several layers and custom-designed blocks, including our novel Learnable Dilation Rate (LDR) module, which is utilized to construct a Noise Estimator module (NE). At the core of AKDT, the NE is seamlessly integrated within standard Transformer components to form the Noise-Guided Feed-Forward Network (NG-FFN) and Noise-Guided Multi-Headed Self-Attention (NG-MSA). These noise-modulated Transformer components enable the model to achieve unparalleled denoising performance while significantly reducing computational costs. Extensive experiments across multiple image denoising benchmarks demonstrate that AKDT sets a new state-of-the-art, effectively handling both real and synthetic noise. The source code and pre-trained models are publicly available at https://github.com/albrateanu/AKDT.
Code (1)
Tasks
Color Image DenoisingDenoisingImage DenoisingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Diversifying and Expanding Frequency-Adaptive Convolution Kernels for Sound Event Detection
Frequency dynamic convolution (FDY conv) has shown the state-of-the-art performance in sound event detection (SED) using frequency-adaptive kernels obtained by frequency-varying combination of basis kernels. However, FDY…
Event DetectionSound Event DetectionGeneralized Dilation Neural Networks
Vanilla convolutional neural networks are known to provide superior performance not only in image recognition tasks but also in natural language processing and time series analysis. One of the strengths of convolutional …
Time SeriesTime Series AnalysisDeep 3D Pan via adaptive "t-shaped" convolutions with global and local adaptive dilations
Recent advances in deep learning have shown promising results in many low-level vision tasks. However, solving the single-image-based view synthesis is still an open problem. In particular, the generation of new images a…
Depth EstimationMonocular Depth EstimationSSIMUnsupervised Monocular Depth EstimationDeep 3D Pan via Local adaptive "t-shaped" convolutions with global and local adaptive dilations
Recent advances in deep learning have shown promising results in many low-level vision tasks. However, solving the single-image-based view synthesis is still an open problem. In particular, the generation of new images …
Depth EstimationMonocular Depth EstimationSSIMUnsupervised Monocular Depth EstimationD-Net: Dynamic Large Kernel with Dynamic Feature Fusion for Volumetric Medical Image Segmentation
Hierarchical transformers have achieved significant success in medical image segmentation due to their large receptive field and capabilities of effectively leveraging global long-range contextual information. Convolutio…
Brain Tumor SegmentationImage SegmentationMedical Image SegmentationOrgan Segmentation+4