Contrastive Monotonic Pixel-Level Modulation
Continuous one-to-many mapping is a less investigated yet important task in both low-level visions and neural image translation. In this paper, we present a new formulation called MonoPix, an unsupervised and contrastive continuous modulation model, and take a step further to enable a pixel-level spatial control which is critical but can not be properly handled previously. The key feature of this work is to model the monotonicity between controlling signals and the domain discriminator with a novel contrastive modulation framework and corresponding monotonicity constraints. We have also introduced a selective inference strategy with logarithmic approximation complexity and support fast domain adaptations. The state-of-the-art performance is validated on a variety of continuous mapping tasks, including AFHQ cat-dog and Yosemite summer-winter translation. The introduced approach also helps to provide a new solution for many low-level tasks like low-light enhancement and natural noise generation, which is beyond the long-established practice of one-to-one training and inference. Code is available at https://github.com/lukun199/MonoPix.
Code (1)
Tasks
TranslationSimilar Papers 제목 키워드 기반
Region-level Contrastive and Consistency Learning for Semi-Supervised Semantic Segmentation
Current semi-supervised semantic segmentation methods mainly focus on designing pixel-level consistency and contrastive regularization. However, pixel-level regularization is sensitive to noise from pixels with incorrect…
SegmentationSemantic SegmentationSemi-Supervised Semantic SegmentationPixel-Superpixel Contrastive Learning and Pseudo-Label Correction for Hyperspectral Image Clustering
Hyperspectral image (HSI) clustering is gaining considerable attention owing to recent methods that overcome the inefficiency and misleading results from the absence of supervised information. Contrastive learning method…
ClusteringContrastive Learninghyperspectral image clusteringImage Clustering+1Non-imaging single-pixel sensing with optimized binary modulation
The conventional high-level sensing techniques require high-fidelity images as input to extract target features, which are produced by either complex imaging hardware or high-complexity reconstruction algorithms. In this…
General ClassificationImage ClassificationInformation-guided pixel augmentation for pixel-wise contrastive learning
Contrastive learning (CL) is a form of self-supervised learning and has been widely used for various tasks. Different from widely studied instance-level contrastive learning, pixel-wise contrastive learning mainly helps …
Contrastive LearningSelf-Supervised LearningOn Monotonicity of the Optimal Transmission Policy in Cross-layer Adaptive m-QAM Modulation
This paper considers a cross-layer adaptive modulation system that is modeled as a Markov decision process (MDP). We study how to utilize the monotonicity of the optimal transmission policy to relieve the computational c…