Source Identification: A Self-Supervision Task for Dense Prediction
The paradigm of self-supervision focuses on representation learning from raw data without the need of labor-consuming annotations, which is the main bottleneck of current data-driven methods. Self-supervision tasks are often used to pre-train a neural network with a large amount of unlabeled data and extract generic features of the dataset. The learned model is likely to contain useful information which can be transferred to the downstream main task and improve performance compared to random parameter initialization. In this paper, we propose a new self-supervision task called source identification (SI), which is inspired by the classic blind source separation problem. Synthetic images are generated by fusing multiple source images and the network's task is to reconstruct the original images, given the fused images. A proper understanding of the image content is required to successfully solve the task. We validate our method on two medical image segmentation tasks: brain tumor segmentation and white matter hyperintensities segmentation. The results show that the proposed SI task outperforms traditional self-supervision tasks for dense predictions including inpainting, pixel shuffling, intensity shift, and super-resolution. Among variations of the SI task fusing images of different types, fusing images from different patients performs best.
Code (0)
등록된 구현이 없습니다.
Tasks
blind source separationBrain Tumor SegmentationImage SegmentationMedical Image SegmentationPredictionRepresentation LearningSegmentationSemantic SegmentationSuper-ResolutionTumor SegmentationSimilar Papers 제목 키워드 기반
Pixel-level Correspondence for Self-Supervised Learning from Video
While self-supervised learning has enabled effective representation learning in the absence of labels, for vision, video remains a relatively untapped source of supervision. To address this, we propose Pixel-level Corres…
Contrastive Learningimage-classificationImage ClassificationOptical Flow Estimation+3Options-Aware Dense Retrieval for Multiple-Choice query Answering
Long-context multiple-choice question answering tasks require robust reasoning over extensive text sources. Since most of the pre-trained transformer models are restricted to processing only a few hundred words at a time…
Multiple-choiceQuestion AnsweringRetrievalImage Re-Identification: Where Self-supervision Meets Vision-Language Learning
Recently, large-scale vision-language pre-trained models like CLIP have shown impressive performance in image re-identification (ReID). In this work, we explore whether self-supervision can aid in the use of CLIP for ima…
Prompt LearningSelf-supervised Geometric Features Discovery via Interpretable Attention for Vehicle Re-Identification and Beyond
To learn distinguishable patterns, most of recent works in vehicle re-identification (ReID) struggled to redevelop official benchmarks to provide various supervisions, which requires prohibitive human labors. In this pap…
Representation LearningSelf-Supervised LearningSemantic SegmentationVehicle Re-IdentificationSelf-supervised Geometric Features Discovery via Interpretable Attentio for Vehicle Re-Identification and Beyond (Complete Version)
To learn distinguishable patterns, most of recent works in vehicle re-identification (ReID) struggled to redevelop official benchmarks to provide various supervisions, which requires prohibitive human labors. In this pap…
Representation LearningSelf-Supervised LearningVehicle Re-Identification