Self2Seg: Single-Image Self-Supervised Joint Segmentation and Denoising
We develop Self2Seg, a self-supervised method for the joint segmentation and denoising of a single image. To this end, we combine the advantages of variational segmentation with self-supervised deep learning. One major benefit of our method lies in the fact, that in contrast to data-driven methods, where huge amounts of labeled samples are necessary, Self2Seg segments an image into meaningful regions without any training database. Moreover, we demonstrate that self-supervised denoising itself is significantly improved through the region-specific learning of Self2Seg. Therefore, we introduce a novel self-supervised energy functional in which denoising and segmentation are coupled in a way that both tasks benefit from each other. We propose a unified optimisation strategy and numerically show that for noisy microscopy images our proposed joint approach outperforms its sequential counterpart as well as alternative methods focused purely on denoising or segmentation.
Code (1)
Tasks
DenoisingImage DenoisingSegmentationSimilar Papers 제목 키워드 기반
Self-Supervised Shadow Removal
Shadow removal is an important computer vision task aiming at the detection and successful removal of the shadow produced by an occluded light source and a photo-realistic restoration of the image contents. Decades of re…
Image Shadow RemovalSelf-Supervised LearningShadow RemovalDoes Self-supervised Learning Really Improve Reinforcement Learning from Pixels?
We investigate whether self-supervised learning (SSL) can improve online reinforcement learning (RL) from pixels. We extend the contrastive reinforcement learning framework (e.g., CURL) that jointly optimizes SSL and RL …
Image Augmentationreinforcement-learningReinforcement LearningReinforcement Learning (RL)+1Multi-task Self-Supervised Visual Learning
We investigate methods for combining multiple self-supervised tasks--i.e., supervised tasks where data can be collected without manual labeling--in order to train a single visual representation. First, we provide an appl…
Depth EstimationDepth PredictionGeneral ClassificationSelf-Supervised Image ClassificationYou Only Look Yourself: Unsupervised and Untrained Single Image Dehazing Neural Network
In this paper, we study two challenging and less-touched problems in single image dehazing, namely, how to make deep learning achieve image dehazing without training on the ground-truth clean image (unsupervised) and a i…
DisentanglementImage DehazingSingle Image DehazingDiverse Imagenet Models Transfer Better
A commonly accepted hypothesis is that models with higher accuracy on Imagenet perform better on other downstream tasks, leading to much research dedicated to optimizing Imagenet accuracy. Recently this hypothesis has be…
DiversityMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATION