Learning Hierarchical Dynamics with Spatial Adjacency for Image Enhancement
In various real-world image enhancement applications, the degradations are always non-uniform or non-homogeneous and diverse, which challenges most deep networks with fixed parameters during the inference phase. Inspired by the dynamic deep networks that adapt the model structures or parameters conditioned on the inputs, we propose a DCP-guided hierarchical dynamic mechanism for image enhancement to adapt the model parameters and features from local to global as well as to keep spatial adjacency within the region. Specifically, channel-spatial-level, structure-level, and region-level dynamic components are sequentially applied. Channel-spatial-level dynamics obtain channel- and spatial-wise representation variations, and structure-level dynamics enable modeling geometric transformations and augment sampling locations for the varying local features to better describe the structures. In addition, a novel region-level dynamic is proposed to generate spatially continuous masks for dynamic features which capitalizes on the Dark Channel Priors (DCP). The proposed region-level dynamics benefit from exploiting the statistical differences between distorted and undistorted images. Moreover, the DCP-guided region generations are inherently spatial coherent which facilitates capturing local coherence of the images. The proposed method achieves state-of-the-art performance and generates visually pleasing images for multiple enhancement tasks,i.e. , image dehazing, image deraining and low-light image enhancement. The codes are available at https://github.com/DongLiangSXU/HDM.
Code (1)
Tasks
Image DehazingImage EnhancementLow-Light Image EnhancementRain RemovalSimilar Papers 제목 키워드 기반
Image contrast enhancement based on the Schrödinger operator spectrum
In this study, we propose a novel image contrast enhancement method based on projecting images onto the squared eigenfunctions of the two-dimensional Schr\"odinger operator. This projection relies on a design parameter, …
Image ReconstructionDual Stream Graph Transformer Fusion Networks for Enhanced Brain Decoding
This paper presents the novel Dual Stream Graph-Transformer Fusion (DS-GTF) architecture designed specifically for classifying task-based Magnetoencephalography (MEG) data. In the spatial stream, inputs are initially rep…
Brain DecodingGraph AttentionCoupled Layer-wise Graph Convolution for Transportation Demand Prediction
Graph Convolutional Network (GCN) has been widely applied in transportation demand prediction due to its excellent ability to capture non-Euclidean spatial dependence among station-level or regional transportation demand…
Uncertainty-Aware Spatial Color Correlation for Low-Light Image Enhancement
Most existing low-light image enhancement approaches primarily focus on architectural innovations, while often overlooking the intrinsic uncertainty within feature representations particularly under extremely dark condit…
Low-Light Image EnhancementHierarchical Spatial Proximity Reasoning for Vision-and-Language Navigation
Most Vision-and-Language Navigation (VLN) algorithms are prone to making inaccurate decisions due to their lack of visual common sense and limited reasoning capabilities. To address this issue, we propose a Hierarchical …
Common Sense ReasoningEfficient ExplorationScene UnderstandingVision and Language Navigation