paper-with-me

홈 › Papers

Self2Seg: Single-Image Self-Supervised Joint Segmentation and Denoising

2023-09-19 · Nadja Gruber, Johannes Schwab, Noémie Debroux, Nicolas Papadakis, Markus Haltmeier

We develop Self2Seg, a self-supervised method for the joint segmentation and denoising of a single image. To this end, we combine the advantages of variational segmentation with self-supervised deep learning. One major benefit of our method lies in the fact, that in contrast to data-driven methods, where huge amounts of labeled samples are necessary, Self2Seg segments an image into meaningful regions without any training database. Moreover, we demonstrate that self-supervised denoising itself is significantly improved through the region-specific learning of Self2Seg. Therefore, we introduce a novel self-supervised energy functional in which denoising and segmentation are coupled in a way that both tasks benefit from each other. We propose a unified optimisation strategy and numerically show that for noisy microscopy images our proposed joint approach outperforms its sequential counterpart as well as alternative methods focused purely on denoising or segmentation.

📄 PDF Abstract BibTeX arXiv:2309.10511

Code (1)

nadja1611/self2seg 공식 구현 pytorch

Tasks

DenoisingImage DenoisingSegmentation

Similar Papers 제목 키워드 기반

Self-Supervised Shadow Removal

2020-10-22 · Florin-Alexandru Vasluianu, Andres Romero, Luc van Gool, Radu Timofte

Shadow removal is an important computer vision task aiming at the detection and successful removal of the shadow produced by an occluded light source and a photo-realistic restoration of the image contents. Decades of re…

Image Shadow RemovalSelf-Supervised LearningShadow Removal

Does Self-supervised Learning Really Improve Reinforcement Learning from Pixels?

2022-06-10 · Xiang Li, Jinghuan Shang, Srijan Das, Michael S. Ryoo

We investigate whether self-supervised learning (SSL) can improve online reinforcement learning (RL) from pixels. We extend the contrastive reinforcement learning framework (e.g., CURL) that jointly optimizes SSL and RL …

Image Augmentationreinforcement-learningReinforcement LearningReinforcement Learning (RL)+1

Multi-task Self-Supervised Visual Learning

2017-08-25 · ICCV 2017 10 · Carl Doersch, Andrew Zisserman

We investigate methods for combining multiple self-supervised tasks--i.e., supervised tasks where data can be collected without manual labeling--in order to train a single visual representation. First, we provide an appl…

Depth EstimationDepth PredictionGeneral ClassificationSelf-Supervised Image Classification

You Only Look Yourself: Unsupervised and Untrained Single Image Dehazing Neural Network

2020-06-30 · Boyun Li, Yuanbiao Gou, Shuhang Gu, Jerry Zitao Liu 외

In this paper, we study two challenging and less-touched problems in single image dehazing, namely, how to make deep learning achieve image dehazing without training on the ground-truth clean image (unsupervised) and a i…

DisentanglementImage DehazingSingle Image Dehazing

Diverse Imagenet Models Transfer Better

2022-04-19 · Niv Nayman, Avram Golbert, Asaf Noy, Tan Ping 외

A commonly accepted hypothesis is that models with higher accuracy on Imagenet perform better on other downstream tasks, leading to much research dedicated to optimizing Imagenet accuracy. Recently this hypothesis has be…

DiversityMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATION