Unsupervised Camouflaged Object Segmentation as Domain Adaptation
Deep learning for unsupervised image segmentation remains challenging due to the absence of human labels. The common idea is to train a segmentation head, with the supervision of pixel-wise pseudo-labels generated based on the representation of self-supervised backbones. By doing so, the model performance depends much on the distance between the distributions of target datasets and the pre-training dataset (e.g., ImageNet). In this work, we investigate a new task, namely unsupervised camouflaged object segmentation (UCOS), where the target objects own a common rarely-seen attribute, i.e., camouflage. Unsurprisingly, we find that the state-of-the-art unsupervised models struggle in adapting UCOS, due to the domain gap between the properties of generic and camouflaged objects. To this end, we formulate the UCOS as a source-free unsupervised domain adaptation task (UCOS-DA), where both source labels and target labels are absent during the whole model training process. Specifically, we define a source model consisting of self-supervised vision transformers pre-trained on ImageNet. On the other hand, the target domain includes a simple linear layer (i.e., our target model) and unlabeled camouflaged objects. We then design a pipeline for foreground-background-contrastive self-adversarial domain adaptation, to achieve robust UCOS. As a result, our baseline model achieves superior segmentation performance when compared with competing unsupervised models on the UCOS benchmark, with the training set which's scale is only one tenth of the supervised COS counterpart.
Code (1)
Tasks
AttributeCamouflaged Object SegmentationDomain AdaptationImage SegmentationObjectSegmentationSemantic SegmentationUnsupervised Domain AdaptationUnsupervised Image SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Open-Vocabulary Camouflaged Object Segmentation with Cascaded Vision Language Models
Open-Vocabulary Camouflaged Object Segmentation (OVCOS) seeks to segment and classify camouflaged objects from arbitrary categories, presenting unique challenges due to visual ambiguity and unseen categories.Recent appro…
Camouflaged Object SegmentationSegmentationSemantic SegmentationWhen SAM2 Meets Video Camouflaged Object Segmentation: A Comprehensive Evaluation and Adaptation
This study investigates the application and performance of the Segment Anything Model 2 (SAM2) in the challenging task of video camouflaged object segmentation (VCOS). VCOS involves detecting objects that blend seamlessl…
Camouflaged Object SegmentationSemantic SegmentationBetrayed by Motion: Camouflaged Object Discovery via Motion Segmentation
The objective of this paper is to design a computational architecture that discovers camouflaged objects in videos, specifically by exploiting motion information to perform object segmentation. We make the following thre…
Motion SegmentationObjectObject DiscoverySegmentation+1DC-TTA: Divide-and-Conquer Framework for Test-Time Adaptation of Interactive Segmentation
Interactive segmentation (IS) allows users to iteratively refine object boundaries with minimal cues, such as positive and negative clicks. While the Segment Anything Model (SAM) has garnered attention in the IS communit…
Camouflaged Object SegmentationInteractive SegmentationSegmentationSemantic Segmentation+1Shift the Lens: Environment-Aware Unsupervised Camouflaged Object Detection
Camouflaged Object Detection (COD) seeks to distinguish objects from their highly similar backgrounds. Existing work has essentially focused on isolating camouflaged objects from the environment, demonstrating ever-i…
Density Estimationobject-detectionObject DetectionRetrieval